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SCHOOL COMMUNITY EDUCATION PROGRAM 
IN NEW YORK CITY ^ 
EVALUATION SUMMARY 



BACKGROUND 

The School Community Education Program (also known as the 
Umbrella Program) , administered by the Division of Curriculum and 
Instxruction, provides a variety of educational and training 
experiences to a vide range of participants, including pre- 
schoolers and their parents, and elementary, intermediate, and 
high school students, teachers, and supervisors. The program 
consists of 37 different projects aesigned to providr., innovative 
solutions to local educational and school problems. Ten projects 
provide basic skills, English as a Second Language, and computer 
literacy instruction; ten focus on social issues and 
environmental studies; seven offer staff development workshops; 
five involve curriculum development, and three are designed for 
prekindergarten children. The remaining projects provide 
participants with a variety of educational experiences. 



POPULATION SERVED 

In 1988-89, the program served some 25,000 students, 
primarily elementary school pupils. In addition, the program 
served 1,100 teachers and supervisors and 100 prekindergarten 
children, as well as neighborhood adults in the 32 community 
school districts and selected high schools. Each project 
established different selection criteria for program 
participation. 



PROGRAM OBJECTIVES 

Although program objectives were designed for each specific 
project and therefore varied, most focused on increasing the 
competence of project participants through mastery of specific 
skills and abilities. Most objectives also set quantitative 
criteria to be met by a minimum percentage of participants for 
the program to be considered successful. 



*This summary is based on the final evaluation report of the 
School Community Education Program in New York City 1988-89, 
prepared by the Office of Research, Evaluation, and Assessment/ 
Instructional Support Evaluation Unit. 



E VALUATION METHODOLOGy 



The evaluation of the program is based on a number of data 
sources: student performance outcomes on standardized or 
project-developed tests, pupil writing samples, teacher and 
student survey questionnaires, number of acceptances to special 
high schools, and review of five curriculum documents. These 
manuals and lesson plans were sent to different units of the New 
York City Board of Education's Division -of Curriculxm and 
Instruction for evaluation* Preprogram and postprogram test 
outcomes were compared to determine mean differences and, when 
appropriate, correlated j^-tests and effect sizes were also 
computed to establish statistical significance and educational 
meaningfulness, respectively. The percentage of participants 
meeting quantitative project-set criteria for success was also 
determined • 



FINDINGS 

The 1988-89 evaluation findings indicate that the School 
Community Education Program was not as successful as it had been 
in previous years, only 15 projects met their stated objectives, 
compared to 19 in 1987-88. In general, those projects providing 
staff development training and curriculum development were the 
most successful. In addition, two projects that provide remedial 
instruction (Harlem School-Community Tutorial Project, and 
Mathematics Improvement Program) were also found to be 
particularly successful. The evaluation also showed that 
al 'chough some projects met their objectives, these results should 
be treated with caution because of the vagueness of the 
objectives or because the evaluation instruments could not 
adequately measure project impact. This is a particular problem 
shared by staff development projects that seeJc to measure teacher 
ability to implement specific teaching skills in the classroom 
without including instruments which measure these skills. 

Four projects were successful in meeting one of their 
objectives, yet unsuccessful in meeting a second objective. 
Sixteen projects did not meet their evaluation objectives, and 
two projects could not be evaluated because test data were 
lacking. As indicated in previous years* evaluations, a few of 
these projects need extensive modifications, such as revision of 
testing instruments to avoid ceiling effect, development of 
project activities appropriate for different grade levels, or 
establishment of more stringent parti jipant selection criteria. 
Most of the unsuccessful projects, however, failed to meet their 
objectives because their criteria for success were too stringent 
or because the testing instrument could not adequately measure 
project objectives • In some of these projects, participants 
achieved large mean gains, but the percentage of successful 
participants remained below the percentage established in the 
project-set criterion for success. In some cases, this criterion 
was beyond what could be reasonably expected of program 
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participants. 



RECOMMENDATIONS 

In addition, to the recommendations made for each project, 
the following suggestions are made for the overall improvement of 
the Schoci Community Education Program: 

* Closely monitor those projects that fail to meet their 
stated objectives. 

* Assist project staff in making necessary project 
modifications such as the revision of project activities, 
revision or replacement of testing instruments, 
establishment of adequate selection criteria of 
participants, or amendments in project objectives. 
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IKTRODUCTION 



In 1988-89, the New York City Public Schools received 
$2,375,000 in funding from the New York State Legislature to 
operate the School Community Education program (also known as the 
Umbrella program). It consisted of 37 different projects 
designed to provide innovative solutions to local educational and 
school programs. 

The program provided services to about 25,000 participants 
in 32 community school districts and selected high schools. 
While most of these participants were elementary school students, 
the program also served some 1,000 intermediate and high school 
students, 100 preschool children, and 1,100 teachers and 
supervisors. Some projects also included parenting components 
and/or sought to involve the parents of participating students in 
project activities. 

Evaluation reports are presented in four volumes. Volume I 
contains evaluations of ten projects that provided reading, 
mathematics, writing, English as a Second Language, and computer 
literacy instruction. Volume II includes evaluations of nine 
projects on social, ethnic, and environmental studies. Four of 
these projects also provided staff development workshops. Volume 
III contains evaluations of seven staff development and five 
curriculum development projects. The remaining six projects, 
presented in Volume IV, offered a variety of educational 
experiences to participants. Three of these projects were 
designed for prekindergarten children, and the other three 
projects were designed to teach students health maintenance 
concepts, tr improve their acceptance rate to special high 
schools, and foster career awareness among students. 

Each report contains a brief project overview, describes the 
evaluation methodology, presents the findings, and provides 
recommendations for improvement. The reports are listed in order 
of budgeted function number in the Table of Contents. 
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THE MUSEUM CONNECTION, 1988-89 

School-Community Education Program 
Program Administrator: M. Morris Speiser 
Project Coordinator: Heywocd Feierstein 

Prepared by: 
Office of Research, Evaluation, and Assessment 
Instructional Support Evaluation Unit 
New York City Public Schools 

PROJECT, DESCRIPTION 

The Museum Connection program is designed to enhance 
positive multicultural awareness among fifth grade students at 
P.S. 398 in Community School District (C.S.D.) 17. The project 
seeks to address problems in the school stemming from negative 
stereotypes, racism, and self-prejudice by developing inter- 
ethnic understanding and cooperation among pupils. Ultimately, 
the goal is that students, their families, and teachers will 
become aware of cultural differences, and that this increased 
understanding will reduce tensions in the school and the 
community. 

In 1988-89, there were 148 participating fifth grade 
students. The school principal and teachers selected 
participants on the basis of students* interest in the program. 
Activities, which were followed up by relevant classroom lessons, 
took place in the Brooklyn Children's Museum. Five groups of 
about 30 students each visited the museum for two hours, one 
afternoon a week, for six-week cycles. At the museum workshops, 
children participated in hands-on exploratory experiences. 

. ERLC 
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Classroom activities supplemented the regular social studies 
curriculum and focused on the study of various cultures, 
mythologies, rituals, and other cultural practices. In both 
settings, the emphasis was on culture and the ways in which it 
influences people's thoughts, values, and actions. The goal was 
that participants would gain an appreciation of the beliefs and 
customs of other people and increase their self-esteem. The 
specific project objective was for 80 percent of the 
participating students to improve by 25 percent their awareness 
and knowledge of cultural differences and similarities that exist 
in their local school community, as measured by a program- 
developed test. 

Project staff consisted of an after-school teacher and a 
part-time supervisor who worked with museum staff to develop an 
appropriate curriculum and introduce it to other teachers in the 
school. The New York State Legislature provided $2,400 to fund 
the project c 

EVALUATION METHODOLOGY 

The evaluation of the project focused on the analysis of 
students* pretect and posttest scores on a programs-developed test 
(see Appendix A) . The test consists of 25 true and false and 
multiple-choice items, it was administered at the beginning and 
end of each project cycle. 
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FINDINGS 

Complete test scores were reported for 148 participants. 
Table 1 presents the results of comparisons of pre- to post- 
program differences in test scores. Overall, the mean pretest 
raw score was 12.8 points (51 percent correct responses) and the 
mean posttest raw score was 16.7 points (67 percent correct), for 
a mean gain of 3.9 points or 16 percent. Mean pretest scores 
ranged from 12 to 88 percent correct responses, and mean posttest 
scores ranged from 32 to 96 percent correct responses. 

only 17 percent of participants met the project-set 
criterion of improving their awareness and knowledge of cultural 
differences and similarities by 25 percent. 
CONCLUSIONS AND RECOMMENDATIONS 

The evaluation findings show that The Museum Connection 
project did not meet its objective of 80 percent of the 
participants achieving a 25 percent gain. This failure to meet 
program objectives could be partly due to a ceiling effect. The 
ceiling effect occurs when a test is too easy. Those 
participants who failed to meet the project-set criterion 
received pretest scores as high as 88 percent. Such high pretest 
scores leave little room for improvement. 

In 1987-88, the testing instrument was revised, replacing 
the essay questions used in previous years with multiple choice 
questions. This revision was made because it was felt that the 
previous test had been too difficult for fifth grade students. 

3 
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Students* Mean Raw Scores" on a Project-Developed Test 
The Museum Connection, 1988-89 







Pretest Mean 


Posttest Mean 


Mean 


Gain 




Raw 
Score 


Percent 
Correct 


Raw 
Score 


Percent 
Correct 


Raw 
Score 


Percent 
Correct 


Students 

Meeting Criterion 
(N=25) 


9.5 


38.0% 


16.2 


64.8% 


6.7 


26.8% 


Students Not 
Meeting Criterion 
(N=123) 


13.4 


53.6 


16.8 


67.2 


3.4 


13.6 


Total 
(N=148) 


12.8 


51.2 


16.7 


66.8 


3.9 


15.6 



•perfect raw score=25. 



Seventeen percent of participants met or surpassed the project- 
set criterion of a 20 percent increase. 
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It would appear that this revision has resulted in a test that is 
now too easy for some fifth grade students. In 1987-88, the 
program was also found to be unsuccessful as a result of the 
ceiling effect. It is recommended that the project staff should 
revise the testing instrument. The test should remain multiple 
choice but the number of questions should be increased and 
questions of a higher difficulty level added to ensure that the 
students will not receive such high pretest scores that they are 
unable to improve their performance as per the stated objective^ 



APPENDIX A 
93405 

^HE MUSEUM CONNECTION 
PRE- POST -TEST 



NAME: 



^^"^^ * CLASS : _R00M : 

"^vrtr^o^rfg^ t^^lT' '^^'^^ ^" parentheses that 

1. The U.S.A. was the first country to practice democracy. 
' ^ F ( ) DK ( ) 

^* SviUzftion^'fn^ ""^l' ^PP^^ knowledge obtained from past 
civilizations to resolve contemporary problems. 

< ' F ( ) DK ( ) 

^* coun??!es?^" ''"^'"'^ '° ''^^"^^ "P^^^^ than other 

' ^ F ( ) DK ( ) 

4. Natural environment helps shape culture. 

' ^ F ( ) DK ( ) 

5. Art does not reflect the traditions of a culture. 

^ F ( ) DK ( ) 

^* ^^Mf3'^"".^""^'^ secondary sources to analyze 
cuitural patterns. 

^ ^ -Ft) DK ( ) 

7. Through migration and immigration people of different 
cultural backgrounds influence one another. 

^ ^ ^ F ( ) DK ( ) 

8. There are universal similarities among all cultures. 

^ ' F ( ) DK ( ) 

GO ON 

-1- 
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THE MUSEU^4 CONNECTION PRE- POST -TEST 



Directions for questions 9-22 ; Darken the letter that gives the 
correct answer. 



9. Every culture: 

(A) has common values and traditions 

(B) must solve problems of establishing relations with 
other groups 

(C) makes adaptive choices based on environment 

(D) all of the above 



10. Which one of the following statements are false about the 
eating customs of a culture: 

(A) Orthodox Jews will not eai pork or shellfish 

(B) many Japanese people sit on the floor to eat 

(C) americans are taught to eat 2 meals a day 

(D) in some cultures^ noise shows an appreciation for food, 
and quiet eating is considered rude 



11. The most obvious thing you could learn about a culture from 
examing its pots and pans is: 

(A) their form of government 

(B) materials available to its people 

(C) their religious customs 

(D) their lavel of communication 



12. All of the following are true about a culture except : 

(A) cultural traits are learned from birth 

(B) geography and climate account for differences between 
cultur s 

(C) cultures do not borrow ideas from one another 

(D) all cultures must meet the basic needs of shelter, food, 
and clothing for its people 



GO ON 



THE MUSEUM CONNECTION PRE- POST-TEST 



13* In studying the language of a culture, we can learn: 

(A) about migrations of people 

(B) how much cultures have borrowed from each other 

(C) stories about things that happened tc people who lived 
long ago 

(D) all of the above 



14, Technology describes how: 

(A) people educate their young* 

(B) people make the things they use, 

(C) - people study 'the effect of" law on crime, 

(D) none of the above. 



15, The wora below that best describes a person who moves to a 
new country to live is a(n): 

(A) nomad* 

(B) follower* 

(C) immigrant* 

(D) tourist* 



16* An example of a cultural custom is: 

(A) the methods people use to predict weather* 

(B) the material used by factories to produce valuable 

machinery* 

(C) the manner in which people eat their meals* 

(D) none of the above* 



17. Technology affects a culture by: 

(A) preventino it from developing into a modern society. 

(B) changing the way people make things and spena their 
leisure time* 

(C) decreasing the need for people to get an education. 

(D) none of the above* 



GO ON 



-3- 
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THE MUSEUM CONNECTION PRE- POST-TEST 
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18. One correct statement about culture is that: 

(A) people •'efuse to follow ana use it in their lives. 
(3) caildren receive no benefits from learning about it 

(C) children learn about culture with very little he\p. 
from their elders. 

(D) elders teach the younger generation about the need to 

use and understand it. 



19. The possible result of two different cultures interacting 
with each other is: 

(A) sharing of ideas and beliefs. 

(B) people trying to understand each other. 

(C) changing ideas about each other. 

(D) all of the above. 



20. One important factor that determines how well a society 
develops is the: 

(A) geography of the region where the society develops. 

(B) type of weights people use to measure pounds and grams. 

(C) number of capital cities found in the society, 

(D) none of the above. 



21. The primary role of an anthropologists is to: 

(A) construct new buildings. 

(B) study and neglect important ideas from the past. 

(C) avoid understanding customs of a society. 

(D) study how people get along in a society. 



22. A scientist could learn this about a society by studying 
one of Its statutes: 

(A) the kind of religious beliefs the people had. 
(S) the kind of clothing they wore. 

(C) the kind of jewelry they ownea. 

(D) ail of the above. 



GO ON 



-4- 
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THE MUSEUM CONNECTION PRE- POST-TEST 
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Directions for questions 23-25 ; 

Study the diagram below to answer questions 23-25. It is a diagram 
that shows a place in Africa that sciencist'ip are studying to learn 
more about the past. The diagram is divided into five levrls. Each 
level has special items left behind by people who lived there over a 
peiriod of a million years. Remember to answer questions 23-25, you 
must study the diagram. 



Level A 


< ^ 








Level B 






7- 




Level C 


0 


O 


0 


o o 


Level D 










Level E 


/. 


/. 


/. 


/. /. 


23. 


The level 


which has 


the oldest items is: 



(A) 
(B) 
(C) 
(D) 
(C) 



Level A 
Level B 
Level C 
Level D 
Level E 



24. The level which has the newest items is; 



(A) 

(B) 
(C) 
(D) 
(C) 



Level A 
Level B 
Level C 
Level D 
Level E 



25. The items left behind here were made by people, therefore, 
they act. examples of: 

(A) rocks 

(B) fossils 

(C) skeletons 

(D) artifacts 



END 



END 



END 



END 



END 



END 



END 



END 



END 
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#5001-48--93407 

PEACE EDUCATION PROGRAM, 1988-89 

School -Community Education Program 
Program Administrator: M* Morris Speiser 
Project Coordinator: Linda Lantieri 

Prepared by:. 
Office of Research, Evaluation, and Assessment 
Instructional Support Evaluation Unit 
New York City Public Schools 

PROJECT DESCRIPTION 

The Peace Education Program sought to implement a conflict 
resolution curriculum in Community School Districts (C.S.D) 15, 
27, and 29 that was specifically designed for elementary school 
students. By emphasizing peace education in the classroom, the 
goal of the project was to help students understand conflict in 
the schools and society at large, and to find creative and 
nonviolent ways to cope with it. The New York State Legislature 
contributed $35,000 to fund the project. 

In 1988-89, 40 teachers and supervisors from each district 
were recommended for program participation by their school 
principals and were selected by the district superintendent. 
After-school teacher workshops werr^ conducted regularly at the 
district offices. Project activities involved both the training 
of participants in the use of a peace education manual and the 
development of methods to implement this curriculum in the 
regular classroom. A draft version of this manual, Resolving 
Conflict Creatively , was developed in 1985-86 by district 
personnel and expert consultants. The manual includes 
objectives, activities, evaluation information, and suggested 
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materials and strategies for implementation. 

The Peace Education Program had two objectives for 1987-88 • 
The first objective was for 80 percent of the participating 
teachers to assign a rating of at least 15 out of a maximum of 
2 , as measured by a project-developed teachers survey on the 
training they received to implement the Peace Education 
Curriculum. The second objective was for 80 percent of the 
participating supervisors to assign a rating of at least 20 out 
of a maximum of 35 on the educational value of the Peace 
Education's Curriculum as measured by a project-developed 
administrator survey. 
EVALUATION METHODOLOGY 

Evaluation consisted of an analysis of teachers' and 
administrators' ratings on project-developed surveys. The 
teachers' survey asked teachers to rate the training they 
received on a scale of 1 (poor) to 5 (excellent). Teachers rated 
iour different components of their training: training sessions, 
curriculum implementation, staff development, and special 
projects (see Appendix A). 

The administrators' survey required administrators to rate 
the educational value of the Peace Education's curriculum on 
their respective schools on a scale of 1 (poor) to 5 (excellent) . 
Administrators rated the progr&.m on areas such as organization, 
ease of use, clarity of language, content usefulness, 

2 
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appropriateness, numbers of activities, and teaching strategies 

(see Appendix B) • 

FINDINGS 

Complete survey scores were reported for 77 teachers and six 
administrators. Table 1 presents the ic^.sults of the teachers' 
survey. Teachers rated all areas survo.yed positively. Training 
sessions received the highest rating, with a mean of 4.4 out of a 
possible five points. Mean combined score for all four 
components surveyed was 16.4 out of a possible score of 20. 

Results of the survey for administrators are presented in 
Table 2. Mean scores for each component surveyed ranged from 4 
to 4.5 points out of a possible five points. Administrators 
rated the Peace Education's Curriculum highest in the areas of 
organization, teaching strategies, and activities. Mean combined 
score for all seven areas surveyed was 30 out of a possible 35 
points • 

CONCLUSIONS AND RECOMMENDATIONS 

In 1988-89, the Peace Education Program was successful in 
meeting its objectives, one hundred percent of administrators 
surveyed rated the educational value of the Peace Education's 
curriculum good to excellent, and eighty-two percent of the 
teachers rated their training in the program good to excellent. 
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Table 1 

Mean Ratings on Te .chers Survey*" 
Peace Education Program, 1988-89 



Component 




Mean Ratinas 




C.S.D. 15 

N = 20 


C.S.D. 27 

N = 20 


Total 
N = 40 


Training Sessions 


4.5 


4.3 


4.4 


Work with Staff Developers 


4.3 


4.2 


4.2 


Curriculum Implementation 


3.9 


3.6 


3.7 


Special Projects 


4.2 


4.0 


4.1 


Total Score' 

(For all four components) 


16.9 


16.1 


16.4 



Teachers rated the above four components of the training on a 
scale of 1 (poor) to 5 (excellent) . Possible total score for 
all four components ranged from five to 20. 

Teachers rated all four areas positively. 

Mean ratings for teachers at C.S.D. 15 were higher than 
teachers at C.S.D. 27. 
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Table 2. 

Administrators • Mean Ratings of Curriculum 
on Project-Developed Survey* 
Peace Education Program, 1988-89 









Mean Ratincrs 




Will^ W I ICS 11^ 


pen 
N = 2 


N = 4 


1 Ouaj. 
N = 6 


Well Organized 


4.0 


4.5 


4.3 


Easy To Use 


4.0 


4.3 


4.2 


Clearly Written 


4.0 


4.3 


4.2 


Content Covers Useful 
Skills and Topics 


4.0 


4.3 


4.2 


Age/Grade Appropriate 


4.5 


4.3 


4.3 


Has Sufficient Activities 


4.0 


4.5 


4.3 


Suggests Effective 
Teaching Strategies 


4.5 


4.5 


4.5 


Total Score* 

(For All Components) 


29.0 


30.7 


30.0 



Administrators rated the above seven components of the 
curriculum on a scale of 1 (poor) to 5 (excellent) . Possible 
total score for all seven components ranged from seven to 35. 
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TABLE 3 

Percentage of Program Participants Meeting 
Project-Set Criterion' 
Peace Education Program, 1988-89 



Survey 



N 



Meeting Criterion 
N % 



Teacher 40 
Administrator 6 



33 
6 



82.0% 
100.0 



To.acher participants will assign a rating of at least 15 on the 
teachers' survey. Administrative participants will assign a 
rating of at least 20 on the administrative survey. 

Eighty-two percent of the teachers and 100 percent of 
tie administrators met the program objective. 
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On x:he Teachers* survey, curriculum implementation received 
the lowest ratings of all four areas • It would appear from the 
results of this evaluation that the Peace Education program has a 
good strong curriculiaa, yet training teachers in the use of this 
curriculum could be improved. It is recommended that future 
project staff identify the weaknesses the teachers saw in their 
training and use this information to strengthen the training 
sessions* 

In addition to the evaluation completed by the Office of 
Research, Evaluation, and Assessment, a private evaluation firm 
completed a more extensive survey including interviews with 
participating teachers and students. That firm's evaluation of 
the program was very favorable. It reported that teachers 
noticed a positive change in their students* attitudes and 
behaviors as a resulc of participation in the project. 
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Peace Education Teacher Survey appFunTY a 
ii/i #b00l-45- -gmT ^^^^^93^07 



Name : 



School : 



District: 



Grade Level : 



Directions: Please indicated your overall rating of the four 

components of the Peace toucation Program by circling one 
number on a five point scale ranging from 1 (Poor to 
5 (Excellent). 



1 . Training Sessions 




Poor 
1 


2 


:>ca 1 e 
3 


4 


Excellen- 
c 


2, Work with staff developers 


1 


2 


3 


4 




3. Curriculum implementation 


1 


2 


3 


4 


5 


4. Special projects 


1 


2 


3 


4 


c 



Raw Score; 
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Name: 



District: 



School : 



Grade Level 



Directions: 



Please indicate your overal 1 rating of the 
educational value of the Peace Education Curriculum 
by circling one number on a five point scale ranging 
from 1 (Poor) to S (Excellent). 



The curricul um 




1 . is wel 1 organized 


Poor txcellenx 
1 2 3 4 5 


2. is easy to use 


1 2 3 4 5 


3. is clearly written 


1 2 3 4 5 


4. content covers useful 
ski 1 1 s and topics. 


1 2 3 4 5 


5. is age/grade appropriate. 


1 2 3 4 5 


6. has sufficient activities. 


1 2 3 4 5 


7. suggests effective 
teachi ng strategies • 


1 2 3 4 5 
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E.C.O.L.E. -EDUCATION AND CAMPING OPPORTUNITY 
THROUGH LEARNING ENVIRONMENT, 1988-89 

School-Community Education Program 
Program Administrator: M. Morris Speiser 
Projec* Coordinator: Marshall Sholtzov 

Prepared by: 
Office of Research, Evaluation, and Assessment 
Instructional Support Evaluation Unit 
New York City Public Schools 

PROJECT DESCRIPTION 

Project Education and Camping Opportunity Through Learning 
Environment (E.C.O.L.E.) is a training program in environmental 
science for elementary school teachers in Community School 
District (C.S.D.) 19. The project uses the facilities and staff 
of the William H. Pouch Environmental Center on Staten Island, 
the Nature's Niche science facility in C.S.D. 19, and the 
Intrepid Air and Space Museum to provide instruction in 
environmental science and staff development training in the 
teaching of science. Teachers and their students in grades four 
through six take part in the program's activities. 

In 1988-89, 30 teachers and approximately 900 students 
participated in Project E.C.O.L.E. Teachers from ten elementary 
schools in C.S.D. 19 were selected by their principals on the 
basis of their need for assistance in science instruction. 
Teachers and students traveled to Camp Pouch every six weeks for 
a total of five times. Camp staft provided instruction in areas 
such as map reading, first aid, pollution, soil conservation. 
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the life cycle of plants, basic astronomy, and environmental 
protection. Teachers were assisted in developing instructional 
units in science that incorporated work in other curriculum 
areas such as mathematics and social studies. District science 
staff developers provided follow-up training in the teachers' 
classrooms and at the Nature's Niche facility. 

The objective for 1988-89 was for teachers to improve their 
ability to develop and implement lessons in environmental 
science. Specifically, 75 percent of participants were to show 
an improvement of at least 25 percent in these skills as 
measured by their pre- and posttest scores on a project- 
developed test. 

The staff of project E.C.O.L.E. consisted of a program 
coordinator, science staff developers, and a school aide paid by 
C.S.D. 19. Camp Pouch also provided instruction at no cost to 
the project. Funding of $48,000 from the New York State > 
Legislature was used to cover the cost of transportation to Camp 
Pouch and the Intrepid Museum, and for the purchase of instruc- 
tional supplies and equipment. 
EVALUATI ON METHODOLOGY AND FINDINGS 

Project impact was assessed by analysis of teachers scores 
on a project-developed test (see Appendix A). The test combined 
multiple-choice, short essay, fill-in, and matching questions to 
assess knowledge of science concepts. The test was given on a 
pre- and posttest basis at the beginning and end of the program. 
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The maximum raw score was 100 points. 

Complete test scores were reported for 30 teachers. Mean 
pretest raw score was 21*2 points, mean posttest raw score was 
50.3 points, for a mean gain of 29.2. Eighteen participants (60 
percent) met the project set criterion for success (see Table 
1). 

CONCLUSIONS AND RECOMMENDATIONS 

In 1988-89, Project E.C.O.L.E. was not successful In 
meeting Its stated objective. Only sixty percent of 
participating teachers met the project set cr^-terlon for 
success. The low mean posttest score (50 percentage points) 
Indicates that the test Is either too difficult or that It does 
not reflect project activities. 

Recommendations based on previous evaluation findings 
pointed to similar problems with the testing Instrument and the 
project objective, and Included suggestions for revision. 
Although project staff acted upon these recommendations, the 
test needs further revisions In order to better assess the 
Impact of the program. The new Instrument should reflect 
project activities and Include Items that measure the 
environmental science skills and teaching techniques developed 
during the course of the program. An alternative and possibly 
better assessment method would be the direct observation and 
evaluation of teacher performance In the classroom. 
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TABLE 1 



Distribution of Teachers' Gains on a Project Developed Test. 

E.C.O.L.E., 1988-89 







Pretest Mean 


Posttest Mean 


Mean 


Gain 




Raw 
Score 


Percent 
Correct 


Raw 
Score 


Percent 
Correct 


Raw 
Score 


Percent 
Correct 


Teachers 

Meeting Criterion 
(N=18) 


22.5 


22.5% 


60.8 


60.8% 


38.3 


38.3% 


Students Not 
Meeting Criterion 
(N=12) 


19.2 


19.2 


34.7 


34.7 


15.5 


15.5 


Total 
(N=60) 


21.2 


21.2 


50.3 


50.3 


29.2 


29.2 



^Perfect raw score=lOO. 



Sixty percent of participants met or surpassed the project-set 
criterion of a twenty percent increase. 
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Even though the project was not judged successful from a 
quantitative stance, it was viewed as an enlightening and enriching 
experience by the participants. Many teachers wrote letters expressing 
their gratitude for being included in the program and stating that the 
children had found it an enjoyable learning experience. 
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Select the letter of the answer that best completes each of the followlnff. 

1. The sun Is a (a) planet (b) star (c) comet: (d) galaxy, 

2. An example of a natural resource Is (a) water (b) oil (c) Iron 

(d) all of the above. 

3/rfater changes to water vapor when It (a) evaporates (b) condenses 
(o) melts (d) freezes. 

if The 1 Ine of zero degrees longitude Is called the (a) equator 

(b) prime meridian (c) North Pole (d) South Pole. 

5. Warmed air moves upward mainly by (a) conduction (b) convection 

(c) evaporation (d) condensation. 

6. A unit used to measure energy amounts Is the Aa) «ran> (^) degree 

(c) calorie (d) meter. 

7. Clouds that Indicate fair weather are (a) stratus (b)cupiulus 

(c) cirrus (d) cumulonimbus. 

8. An element Is a substance made entirely of one kind of 

(a) molecule (b) solution (c) compound (d) atom. 

9 Closely spaced contour lines on a topographic map are a sign of 

(a) a mountain top (b) a great plain (c) a steep slope (d) a gentle 
slope. 

10. Contour lines on a weather map usually show the pattern of 

(a) air pressure (b) wind speed (c) rainfall (d) clouds. 

11. ftiln that freezes before It hits the ground Is (a) slush (b) drizzle 

(c) hall (d) sleet. 

12 When the air Is saturated Its relative humidity Is (a) 100^ (b) 75% 
(c) 50% (d) 0%. 

13. A powerful cyclone formed over the ocean in tropical air 

(a) thunderstorm (b) hurricane (c) tornado (d) blizzard. 

l^l-.The water supply Is constantly renewed by (a) precipitation 

(b) the water cycle (c) plants (d) oceans. 

15. A common feature of sedimentary rocks is (a) smooth texture 
(b) glassy texture (c) fossils (d) small holes 



Fill In 

Complete the followlnp:. 

1. K natural resource Is 

2. A vertebrate Is an animal with a _ 
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3. List the five major groups of vertebrate animals . 

^, . and . . 

4. The three forms of matter are _, . • 

5. The three layers of the earth are 

6. An object's size Is Its 



, and 



7. Parallel lines north and south of the equator are lines of _ 

sjwhen contour lines are close together then the shape or elevation 

of the land Is • 

9. A boundary between two different air masses Is a . 

10. The main source of energy Is the 

11. Soil Is a mixture of weathered rock and , . |^ 

12. The breaking down of rock by changing Its chemical composition 
Is called — - » 

13. Three groups of rocks are . — 

lit. A stream will begin to deposlte as its speed 



15. Seventy percent of the earth's surface is covered by _ 



Katchlnff Questions 93408 
Put the letter In column B next to the best defmtlon In column A. 





A 




B 


1. 


A line on a map connecting places 
i^nau nave zne same elevation 


(a) 


ero«5ion 


2. 


Boundary between two different 
air masses 


(b) 
(c) 


ore 

cl Ima te 


3. 


A puffy cloud 


id) 


conservation 


^. 


Sura of all weather occurring 
over many years 


(e) 


fracture 


5. 


A single solid element or compound 
occurring naturally In the earth's 
crust 


(f) 
(g) 


front 
gem 


6. 


A beautiful non metallic mineral 


(h) 


magma 


7. 


A mineral resource that can be 
mined for profit 


(1) 
(J) 


contour line 
lava 



9. The tendency to break along smooth surfaces (k) cumulus 
The tendency to break unevenly (1) mineral 

10. Hot molten rock underground („,) cleavage 

(n) finvlronraent 
(o) stratus 
(p) vertical 
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Short Answer 

l.Show a di«iffram of the w^l?er cycle and explain. 

"2;What' ktni of envArnraent would be created If any part of the water 
cycle was Interrupted? 

3. Describe a directional compass, its proper use and how It worka. 

I*-';*' Describe four different environments. .How are they the same? how 
are thrsy different? 

5. What is pollution? How can we control pollution? 

6. What is erosion? Describe three natural forces of erosion and how 
each force erodes the land. 
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URBAN ENVIRONMENTAL PROGRAM 
FOR ELEMENTARY SCHOOL PUPILS, 1988-89 

School-Community Education Program 
Program Administrator: M, Morris Speiser 
Project Coordinator: Charles Monaco 



PROJECT DESCRIPTION 

The Urban Environmental Program for Elementary School Pupils 
provided instruction on natural and man-made environments to 
elementary school students in Community School Districts 
(C.S.D.s) 13, 15, 17, 18, 20, and 22* Each district designated 
at least four schools which, in turn, selected at least four 
classes to participate in the program. Participating classes 
were selected by school principals on the basis of student and 
teacher interest, and readiness to participate in the program. 

Some 1,400 elementary school students participated in the 
program in 1988-89. Instructional activities included an 
orientation school visit by project teachers, and four two-hour 
fields trips to Prospect Park in Brooklyn between September and 
June. These field trips combined nature walks and street tours 
in the nearby neighborhood of Park Slope with follow-up lessons 
at the park's Environmental Center. In addition, teachers 
offered an in-school environmental program, called Neighborhood 
Streetscapes, and a Built Environment program, focusing on urban 
architecture and urban history, planning, and design. The New 
York State Legislature contributed $41 thousanc? to support this 



Prepared by: 
Office of Research, Evaluation, and Assessment 
Instructional Support Evaluation Unit 
New York City Public Schools 
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program. 

The project objective was for 80 percent of the participants 
to demonstrate an increase in their awareness and appreciation of 
natural and urban environments by achieving a gain of at least 25 
percent from pretest to posttest on program-developed tests. 
EVALUATI ON MRTHODOLQGV 

Evaluation activities focused on analyses of student 
po.rformance on three different project developed tests (see 
Appendix A). The first test, Neighborhood Streetscapes, consists 
of IS multiple choice items concerned with architectural features 
and materials. The other two tests, Park for All Seasons, and 
Changing Seasons, consist of multiple choice questions on natural 
and man-made environments. A sample of approximately 20 percent 
of the total student participants were administered one of the 
three tests at the beginning and end of project activities. The 
test administered to the students depended on the emphasis of the 
program for those students. 
FINDINGS 

Complete test scores were reported for a total of 123 
students on the Neighborhood Streetscapes test. Table 1 presents 
students' mean raw scores and mean gains on the Neighborhood 
Streetscapes test, by school. Pretest scores ranged from 28 to 
53 percent correct responses, with a mean of 41.3 percent. 
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Table 1 

Student's Raw Scores on the 
Neighborhood Streetscapes Test 
by School 

Urban Environmental Program, 1988-89 







Pretest Mean 


Posttest Mean 


Mean Gain 






Raw 


Percent 


Raw 


Percent 


Raw 


Percent 


School 


N 


Score 


Correct 


Score 


Correct 


Score 


Correct 


P.F 97 


19 


6.3 


42.0% 


9.9 


66.0% 


3.6 


24.0% 


P.S. 112 


26 


7.9 


52.7 


9.5 


63 .3 


1.6 


10.7 


P.S 124 


28 


5.8 


38.7 


9,1 


60.7 


3.3 


22.0 


P.S. 249 


40 


5.7 


38.0 


10.5 


70.0 




32.0 


P.S. 287 


10 


4.2 


28.0 


6.6 


44 .0 


2.4 


16.0 


Total 


123 


6.2 


41.3% 


9.6 


64 .0% 


3.4 


22.7 



■perfect raw score=15. 

Overall, students achieved a 22.7 percent gain from pretest to 
posttest. 

Students at P.S. 249 achieved the largest mean gain. 
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Posttest scores ranged from 44 to 70 percent correct responses, 
with a mean of 64 percent. Mean gains ranged from 11 percent to 
32 percent correct responses, with a mean of 22.7 percent, p.s. 
24 9 had the highest mean gain. The percentage of students 
meeting the project-set criterion of a 25 percent gain on the 
posttest of Neighborhood Streetscapes is presented in Table 2. 
Overall, 48.8 percent of the program participants sampled met or 
surpassed the project set criterion. Students at P.S. 249 had 
the highest success rate, 65 percent. 

CONCLUSIONS AND T^ECOMMENDATTQTJS 

In 1988-89, the Urban Environmental Program was not 
successful in meeting its objective of 80 percent of 
participating students achieving a 25 percent gain from pretest 
to posttest. Overall, only 48.8 percent of the students met this 
criterion. P.S. 249 had the largest percentage of students, 65 
percent, who met or surpassed the project-set criterion, whereas 
P.S. 112 had the lowest, 23.1 percent. One possible explanation 
for the variation in scores across schools is the grade levels of 
the sampled students. P.s. 249 sampled fifth grade students and 
P.S. 112 sampled third grade students. This would suggest that 
the test may be too hard for some third grade students, students 
at P.S. 112 showed the largest variation in scores with gains 
ranging from a loss of 2 raw score points to a gain of 8 raw 
score points. 
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In 1987-88, it was recommended that the number of tests used 
to evaluate the program be reduced, because it is difficult to 
make meaningful comparisons across the different tests. Instead 
of following the above recommendation, in 198B-R9, only those 
students taking the Neighborhood Streetscapes test were sampled. 
Although this does facilitate comparisons between students on 
this test, it ignores those students participating in the other 
two components of the program. Changing Seasons and Park for All 
Seasons. In the future, it is recommended that, if possible, one 
test be developed to test all students of a given grade level for 
all components of the program combined, in addition, several 
levels of the tesc should be developed to enable the evaluation 
of all participating grades. 

In 1988-89, scores were reported for only third through 
fifth grade students in one component of the program. 
Neighborhood Streetscapes. Considering that the program is 
designed for all elementary school children, it is important to 
examine its impact on all participating grades, it is also 
important to assess the- impact of all three components of the 
program. Therefore it is recommended that, in the future, 
program staff provide a sample of students from all grade levels 
participating in each of the three components of the program. 
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In 1987-88, it was recommended that the number of tests used 
to evaluate the program be reduced, because it is difficult to 
make meaningful comparisons across the different tests. Instead 
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Although this does facilitate comparisons between students on 
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Seasons. In the future, it is recommended that, if possible, one 
test be developed to test all students of a given grade level for 
all components of the program combined, in addition, several 
levels of the tesc should be developed to enable the evaluation 
of all participating grades. 

In 1988-89, scores were reported for only third through 
fifth grade students in one component of the program. 
Neighborhood Streetscapes. Considering that the program is 
designed for all elementary school children, it is important to 
examine its impact on all participating grades, it is also 
important to assess the- impact of all three components of the 
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Tti« Ttnnlt Nmm 

;'».».et f.rk APPENDIX A 



tErGffiOfflGCD STREETSCaPS Pfg-TS7/Pn<;T-7F?n- •;~J'rjj H-r. iiJis 93414 

Scfrol: CIQSS: Dote: '"'''^ 



(tot) (First) 



CiraaS: ^ eccJi of ti'-e tt.'estJcns belw careful Iv end cJioose t.'s len=r of 
S'tteS^tSif''"^ """'"^ cn^ lira in f.i^t 

^' S'"^,*^ tKiliing parts that cai be used m c'^saaticrs eze a) brackets 

6) dentils el panel* d) colsams e) all of thae. 

^' 21! ?ff5f ^ of the buildinc b) sides of 

the.hiiMLng c) back of the building d) fiwt dooTl) nc^ IfS^. 

^' 5°2^"&5SfL5*^, SLf!f^ ^ lir-^ b) chanced a great deal 

,ttB^eig?gS!^ «i)beca»r«d««.e, stayed Sana 



^ A circle, a rectangle, and a square are exsnples of a) cclcrs b) s^Aces 
c) patterns d) textaa^s e) aU of ttese, • • 

. ?• Building omaraents vhidi are shaped liJce teeth are*caUed a) areas 

b) coltrns c) dentOs d) shingles e) aU of these, 

Asu^, anooth, and scratchy are exaroles of a) designs b) oattema 

c) textures d) structure e] all of e^se. • 



— A stone inscribed with the date of construction of tJ« building is caUed 
a a) cornerstone b) keystone, c) cornice d) colum e) all cf these, 

— emi^SfSeS^"* *^ buildings b) sidewaUcs c) signk d) lant? posts 

Jll. C)e steps at the front of some buildings are called a}a facade b) a stoco 
c) a bay d) a bradcet e) all of these. ' 

_J2. ^y starring buildings in a neighborhood we can learn about a) history 
b) arrfutecture c) social studies d) art e) aU of these. ' 

_J3. The first job in constructing a building is 

a) digging the foundation 

b) deciding its 

c) drawing the plans 

d) connecting the we ter* pipes 

e) pouring the concrete. 

_14. Uie ftge of a buUding is scretijtes shown by its. a) oomsrstone b) shape 

c) decorations d) materials e] all of these. 

_15. Brooklyn contains many 
~ a} neighborhoods 

b} cities 

c} states 

d) counties 

e) all of these. 
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• .t-mbrtXIa Program B/E» S001>48-834;4 
NW« CUSSS 



CHANGING SEasaS/GlAMSX:^ P/vTrgeg: lSg7»88 ARTS IN EsuamcN 

Oirecticns: For each of the followinr qijestdcns,cfr5os« the best answar 
and write t^e letter of that answer on the line at Lhc left. 

'Rpses Rc^.^B food and water through their (a) barh, Cb) arteries, 

(c) >^lea and piOoere, (d) heartrnxi. 

, 2. Prospect Paifc docs not have , 

(«) oak trees, (b) pijie trees, (c) %ald onion, (d) sugar cane. 

3 > A directional coqpass points north because of 

(a) the earth's wagnetisii, (b) wind from the nor5u ' 

(c) solar energy, (d) chemical reacticns. 

4. Squirrelii in winter. 

(a) hibernate, (b) forage, (c) migrat:^, (dl stei their fur. 

S . A map's I^end or Jcey dicws . 

(a) who drew the wep, (b) cardinal directicns, (c) the neanings of 
the syirbols on the mep, (d) the history of raps and trapping. 

Clover, dandelion, and plantain wculd nost liJcely be found in 

a habitat. 

. (a) meadow, (b) %ooqs, (c) marsh, (d) pcnd. 

}^ Willcw and cypress trees grow best in a habitat. 

ta) iMdcfrT, (b) rodcy hilltop, (c) swartp. (d) dry. 

8. Mhich food dialn would you find In Prospact Park? 

(a) plankton -tcspepod ^ fish 

(b) oak tree squirrel-^ hav* 

(c) grass plant beetle-^ frog 

(d) all of these. 

?. .In 'on ecosystem, sake their own food. 

(aj* producers (b) consuiETs (c) decoiposcrs (d) all of th»se. 

1 0. In 6n ecosv'Steni, eat living plants or anijials. 

(a) producers (b) constinirs it) decoijxssers (d) all of ttese. 

11» Seasonal changes influence the lives of (al green plants, 

(b) pond animals, tc)squirrels and birds, (d) all of ths9e« 



_12. Parks are used by (a) young children, (b) senior citizens, 
to} adults, (d) all of th^sa. 

^13. SncM is (a) fro2en water vapor crystals, (b) frozen rain, 
"* (p) ice pellets, (d) none of these, 

JL4. Soil is nade of (a) rocks, (b) leaves, (c} roots, (d) all of these. 

15. Miich of ti« following oould be cadled a work of art? 

(a) a poan, (b) a painting, (c) Prospect Park, (d) all of these. 

Otees drcp their leaves because tl>ey (a) are at ti^ end of their 
life cycle, (b) are dying, (c) are fully grown, (d)- all of these. 

J17. He diange in seasons is caused by: (a) the sun moving closer to the 
corth, (b) tlie position of tl)e* earth in its orbit around the sun, 
(c) tJ« pull of gravity on tl\e earth, (d) all of these. * 



rttt: rtruw w^t^r/rrA\mcj rAnn^ tr.conw, /.w yonn mis. . .thu(7IX| 7ts*t$^0 
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J18. Wo shcudd kse? thst peirJ: clean? (a) park workers, Cb) children whs 
visit the park, (c) pecple who ha\^ picnic, (d) adl o£ these. 

JL9. He tarpcratare of a pcnd is (a) always hiaher than the air 
temperature surruijidin^ it, (b) alwaj's lower than the air tsip- 
eraturc surroaxiiiig it, (c) the sare as the air ternperature 
sumwding it, (d) none of these. 

20. Pecple use parks in the city (a) to play, (b) for exercise, 
(c) to relax and enjoy the outdoorsr (d) all o£ these. 
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PROSPECT PARK ENVIRONMENTAL CENTER 



SCHOOL GRADE_ 

Name 



LAST FIRST 



PARK OF ALL SEASONS PROGRAM FOR ELEMENTARY SCHOOL STUDENTS 



Directions: For each of the following questions^ choose the best 
answer and write the letter of that answer on the line at the left. 

. 1. The skin of 5 tree is called its 

(a) leaves (b) stem (c) shell (d) none of these 

2. Prospect Park has 



(a) deciduous trees 

(b) evergreen trees 

(c) deciduous and evergreen trees 

(d) all of these 



3, In the winter, the deciduous trees in Prospect Park are 

(a) resting 

(b) without any leaves 

(c) no loiiger making their own food 

(d) forming buds for tha spring 

(e) all of these 



4. In late summer, trees 



(a) start producing buds 

(b) start changing colors 

(c) are in full bloom 

(d) begin to store food in their roots 

(e) all of these 



5. During the autumn months^ squirrels 

(a) collect and store food for the colder weather 

(b) prepare their nests 

(c) migrate to warmer climates for the winter 

(d) all of these 

(e) all of these except (c) 
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6. 



Insects are found in Prospect Park 
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(a) only in the spring 

(b) during the summer 

(c) ail year rounJ 

(d) none of these 

7. Birds found in Prospect Park 

(a) migrate during the winter months 
(b; hibernate all winter 

(c) stay as long as they can find food ana shelter 

(d) none of these 

(e) all of these except (b) 

8. The meadow in Prospect Park has 

(a) grass 

(b) clover 

(c) plantain 

(d) dandelions 

(e) all of these grow in it. 

9. Evergreen trees 

(a) stay green all year round 

(b) drop a few leaves at a time 

(c) have needle-shaped leaves 

(d) produce coneis 

(e) all of these 

10. Prospect Park is owned buy 

(a) the mayor of New York City 

(b) the City of New York 

(c) the Parks Department 

(d) the people of New York City 

11. Seasonal changes influence the lives of 

(a) green plcints 

(b) pond animals 

(c) squirrels and birds 

(d) insects 

(e) all of these 

12. Soil is made of 

(a) broken down rocks 

(b) living organisms 

(c) remains of dead plants and animals 

(d) all of these 
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13 • in order for trees to produce new young trees, they make 

(a) soil 

(b) tree rings 

(c) seeos 

(d) birds 

(e) none cf these 

14. The change in the seasons is caused by 

(a) the sun moving closer to the earth 

(b) the path of the moon*s orbit around the sun 

(c) the pull of gravity on the earth 

(d) the position of the earth in its orbit 
around the sun 

(e) none of these 

15. Who should keep the park clean? 

(a) park workers 

(b) children who visit the park 

(c) runners and bicyclists in the park 

(d) people who picnic in the park 

(e) all of these 
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STAR LABS, 1988-89 

School-Community Education Program 
Program Administrator: M. Morris Speiser 
Project Coordinator: Valerie Cavallero 

Prepared by: 
Office of Research, Evaluation, and Assessment 
Instructional Support Evaluation Unit 
New York City Public Schools 

PROJECT DESCRIPTION 

The Star Labs program is designed to introduce elementary 
school students to the major concepts in astronomy. A mobile 
Star Lab planetarium was utilized to assist in instruction. The 
State Education Department provided $35 thousand in funding for 
this project. 

in 1988-89, 75 teachers and 1500 students from all 
elementary schools in community school district (C.S.D.) 20 
participated in the project. Three fourth grade classes from 
each school were chosen to participate by the principals of each 
school and the district superintendent. The program emphasized 
astronomy and the earth's relation to the sun, moon, planets, and 
other solar systems* Students received classroom instruction 
followed up by visits to the mobile Star Lab Planetarium. Each 
class visited the planetarium at least five times. 

The objective was for 80 percent of the participating 
students to demonstrate a 30 percent increase in knowledge of 
astronomy and related topics in science as measured by a 
district-developed test. 
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EVALUATION METHODOLOGY 

The evaluation consisted of an analysis of participating 
student •s pre- and posttest scores on a district-developed test 
(See J>ppendix A) • The test consisted of 15 multiple choice items 
and was designed to measure students • knowledge of astronomy and 
related topics in science* 
FINDINGS 

Complete test score-} were reported for 75 participating 
teachers. Table 1 presents a comparison of participants mean 
pre- and posttest scores, and the percentage of participants 
meeting the project-set criterion of a 30 percent increase. 
Px-ogram participants scored a mean of 31 percent correct 
responses on the pretest, and 58 percent correct on the posttest, 
for a mean gain of 26 percent. Twenty-nine out of the 75 
participcints (39 pe-r-cent) met or surpassed the project set 
criterion of a 30 percent increase on the posttest. 
CONCLUSIONS AND RECOMMENDATIONS 

During the 1988-89 school year, the Star Labs project was 
not successful ^ meeting its objective of 80 percent of the 
participants achieving a 30 percent gain in knowledge of 
astronomy. Only thirty-nine percent of students met the project- 
set criterion. 

From the information provided to the Office of Research, 
Evaluation, and Assessment, it is impossible to adequately assess 
why the project did not meet its objective. One possible 

2 
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explanation is that the test docs not reflect what is being 
taught in the program. Another explanation is that the objective 
is too ambitious. It is recommended that project staff review 
the testing instrument to assure that it is correlates with what 
the students are learning in the program. In addition, project 
staff may wish to revise the objective to "75 percent of students 
will achieve a 25 percent gain." 
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D1 recti ens : Plea2e choose the answer \/hich best coirpletes the statenent 

or answers the question. Mark the letter answer on the separate 
answer sheet. 



1. The sun seeins to be moving across the sky because 

a) it is moving around the earth. 

b) the earth is revolving around the sun. 

c) the earth is rotating on its axis. 

d) the sun noves to the other side of the earth, 

2. The sun's path across the sky is called the: 

a) horizon. 

b) rueridian. 

c) ecliptic. 

d) equinox. 



3. How lonn does it take for the earth to revolve around the sun once? 

a) 3 months. 

b) 24 hours. 

c) 365 days. 

d) 6 months. 

4. How long does it take the earth to rotate once on its axis? 



a) 3 months. 

b) 24 hours. 

c) 365 days. 

d) 6 months. 



How often can you see the moon in the daytine during the month? 



a) always. 

b) most of the time. 

c) 3 times. 

d) never. 



60 ON 



Approxima^-el V how nanv stars can v/e see with our «ve from ou 
in the city? 



a) 3000. 

b) 10,000. 

c) 1C0,00C. 

d) 1 ,000,000. 

The reason we are unable to s^e as many stars from the city as we 
able to see in the country is: 

a) air pol lution. 

b) the horizon is blocked by buildings. 

c) 1 ight pollution. 

d) that people are unable to see in the dark. 

How much of the sky can we see from our homes in the city? 

a) 1/2. 

b) 1/4. 

c) 3/4. 

d) the whole thing. 

The highest point above us that we can see is called the: 

a) horizon. 

b) zenith. 

c) ecliptic. 

d) miridian. 

What is the brightest star that we can see in the night sky? 

a) Sirius. 

b) Betelgeiise, 

c) Rigel. 

c) North Star. 

The pointer stars in the Big Dipper point to: 

a) the North Star. 

b) the Great Bear. 

c) Orion. 

d) Draco the Dragon. 



GO ON 



12. Another name for the North Star is: 



a) Polaris* 

b) Vega. 

c ) Si ri us . 

d) Betelecuse. 

13. A picture made by connecting the stars is called a : 

a) myth. 

b) constellation. 

c) planetarium. 

d) cluster. 

14. How many stars make up the Big Dipper? 



15. We are unable to see the same constellations in the sky all year 
around because: 

a) the earth is revolving around the sun. 

b) the sun is moving around the earth. 

c) the stars are moving around the sun. 

d) the stars are moving around the earth. 



END END EK'D END END END END END END END 



a) 
b) 
c) 
d) 



6 
9 
7 
5 
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ANSWER KEY - STUDENT EVALUATION STAR LAB 



1. 


C 


2. 


c 


3. 


C 


4. 


B 


5. 


B 


6. 


A 


7 




8. 


B 


9. 


B 


10. 


A 


11. 


A 


12. 


A 


13. 


B 


14. 


C 


13 


A 
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WAVE HILL URBAN ENVIRONMENTAL PROGRAM, 1988-89 

School-Community Education Program 
Program Administrator: M, Morris Speiser 
Project Coordinator: Maria Caban 

Prepared by: 
Office of Research, Evaluation, and Assessment 
Instructional Support Evaluation Unit 
New York City Public Schools 

PROJECT DESCRIPTION 

The Wave Hill Urban Environmental program is a training 
project in urban environmental science for elementary and junior 
high school teachers in Community School Districts (C.S.D.s) 9, 
10, and 11. The project goal is for teachers to gain confidence 
in their teaching of science and for students to view science as 
a living subject. The project received $26 thousand in funding 
from the New York State Legislature. 

Schools and teachers were recommended for project 
participation by district superintendents and school principals. 
Teachers and their students visited the Wave Hill Environmental 
Center for workshops and training in local geology, botany, and 
mapping. They also participated in workshops designed to help 
them make use of urban scientific resources. Wave Hill staff 
supplemented these activities with classroom visits in which they 
assisted teachers in planning lessons and implementing in-clMS 
proj ects. 

The objective for 1988-89 was for 80 percent of teacher 
participants to demonstrate a 40 percent pre- to posttest 
increase in their knowledge of environmental science instruction. 
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EVALUATION METHOn pLOGV AWD FINDINGS 

Project impact was assessed by an analysis of teachers' 
scores on a project-developed test of scientific knowledge given 
at the beginning and end of the project (see Appendix A) . The 
test included identifications, matching columns, and short 
essays. The posttest included an additional section that covered 
the specific topics taught in the training sessions and field 
trips. Teachers who studied different topics were required to 
take a section that addressed that area. The maximum score 
possible was 100 points. 

Pretest and posttest data were reported for the seven 
teacher participants at C.S.D. lo. overall, pretest mean raw 
score was 40.7 points, and posttest mean raw score was 85.4 
points, for a mean gain of 44.7 percent (see Table l) . overall, 

fifty-seven percent of the participating teachers met or 

p 

surpassed the project-set criterion of a 40 percent gain. 
CONCLUSIONS AND P fCOMMENDA TTnWfi 

The Wave Hill Urban Environmental Project did not achieve 
its objective of improving 80 percent of teachers performance by 
40 percent on the project developed test, overall, only 44.7 
percent of participants achieved a gain of 40 percent from pre- 
to posttest. Those participants that did not meet the project- 
set criterion had a mean pretest score of 63.5 percent correct 
responses, such high pretest scores preclude a 40 percent jain 
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TABLE 1 



Teachers* Mean Raw Scores* on a Project Developed Test, 
Wave Hill Urban Environmental Program, 1988-89 



Pretest Mean Posttest Mean Mean Gain 



Teachers 

Meeting Criterion*^ 23.7 84.1 60.4 

(N-4) 

Teachsrs Not 
Meeti] 
(N=3) 



Meeting Criterion^ 63.5 87.2 23.7 



Total 

(N=7) 40.7 85.4 44.7 



^Perfect raw score=^100. 

'^Participating teachers will achieve a 40 percent gain at 
posttest . 

Overall, fifty-seven percent of the teachers met or 
surpassed the project-set criterion. 
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on posttest and indicate that the test is too easy (ceiling 
effect). The instrument should be revised, eliminating those 
questions that most participants know before their participation 
in the project and adding more difficult items. It would also be 
better if only one test served as both a pretest and posttest 
rather than administering two different forms. The present 
instrument raises the question whether pretest and posttest 
scores can be meaningfully compared. 

In 1988-89, complete test scores were recieved for 
participating teachers in C.S,D, 10 only. In the future, project 
staff should include test scores for all teachers participating 
in all districts. 

Finally, the objective should be revised, A 40 percent gain 
is too ambitious, A more realistic objective would be for "75 
percent of participating teachers to achieve a 25 percent gain 
from pre- to posttest". 
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WHEN THE WELL'S DRY, 
WE KNOW THE WORTH OF WATER. 
— BENJAMIN FRANKLIN 

1. THE AVERAGE AMERICAN DRINKS A. 80 

QUARTS OF WATER EACH DAY. 

. B. 3, 00'^, 000 

2. WE USE GALLONS OF WATER FOR 

EACH 5 MINUTE SHOWER. C. 1.5-5 

"3. EACH TIME YOC FLUSH THE TOILET, YOU D. 578 

CONTRIBUTE GALLONS TO YOUR 

LOCAL SEWAGE PLANT. ^tt^^ E. 75 

4. WE EACH ACCOUNT FOR GALLONS P. 320 

OF SEWAGE EACH DAY. 

5. NEW YORK CITY HAS OPERATING G. 200,000,000 

SEWAGE TREATMENT PLANTS, 

UNDER CONSTRUCTION, AND % OF H. 7 

ITS SEWAGE NOW TREATED. 

I. 18,000,000,000 

6. NEW YORK CITY'S DRINKING WATER IS 

IMPORTED VIA AQUEDUCTS FROM OVER J. 3 
MILES AWAY. 

K. 100 

7. NEW YORK CITY HAS MILES OF 

SHORELINE, MILES OF PIERS L. 4-7 

AND BULKHEADS, AND MILES OF 

DEVELOPED BEACHES. M. 17 

8. A WASTEWATER TREATMENT PLANT IN N. 1,400,000,000 
NEW YORK CITY CAN COST AS MUCH AS 

AND TREAT AS MUCH AS 0. 15-20 

GALLONS PER DAY. 

P. 22,000 

9. NEW YORK CITY TREATS GALLONS OF 

WASTEWATER EACH DAY, ENOUGH TO FILL Q. 14 

YANKEE STADIUM TIMES. 

R. 125 

10. THERE ARE MILES OF STREAM 

IN THE U.S. S. 70,000,000 

11. THERE ARE MUNICIPAL WATER 

SUPPLY SYSTEMS IN THE COUNTRY. 

12. U.S. EPA PAYS % OF THE TOTAL 

COST OF A SEWAGE TREATMKNT SYSTEM. 

13. U.S. EPA IS IN THE PROCESS OF SPENDING 

OVER DOLLARS TO CLEAN UP OUR 

NATION'S WASTEWATER. 



AFTERTHOUGHT: WHY ARE MANHOLE COVERS ROUND? 
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1. OF THE TEN (10) PLANTS DISPLAYED WHICH ONE IS IMPORTANT IN THE 
MONARCH CATERPILLARS LIFE CYCLE? 

2. HOW MANY YEARS DO DANDELION PLANTS LIVE (IF NOT ELIMINATED BY 
UNNATURAL CAUSES.) 

3. FIND 5 (FIVE) EXAMPLES OF MONOECIOUS PLANTS FROM THE GROUPING 
PROVIDED. 

4. GIVE THREE CHARACTERISTICS OF AN INSECT. 

5. NAME AN INSECT WITH NO METAMORPHOSIS. 

6. FIND AND COLLECT LEAVES FROM FOUR TREES WITH OPPOSITE ARRANGE- 
MENTS AND FOUR WITH ALTERNATE ARRANGEMENTS AND KEY OUT THEIR 
GENUS AND SPECIES. 

7. WHAT IS THE NORTHERN MOST POINT AT WHICH THE SUN'S RAYS STRIKE 
THE EARTH DIRECTLY ON THE FIRST DAY OF SUMMER? 

8. WHAT ARE THE TWO BASIC COMPONENTS OF SOIL? 

9. DEFINE CHLOROPHYLL 

10. NEW YORK CITY HAS HOW MANY OPERATING SEWAGE TREATMENT PLANTS IN 
OPERATION TODAY? 

11. THE AVERAGE AMERICAN DRINKS HOW MANY QUARTS OF WATER EACH DAY? 

12. HOW WERE INDIAN CANOES IN THE EASTERN PART OF THE COUNTRY MADE? 

13. WHEN MANY EASTERN AMERINDIANS SPOKE OF THE 3 SISTERS, WHAT DID 
THEY MEAN? 

14. DEFINE MELANIN. 

15. WHAT ARE THE 3 TYPES OF ROCKS? 

16. CHOOSE FROM THE ROCK SAMPLES THE THREE MAJOR BEDROCKS OF 
NEW YORK CITY. 

17. WHAT IS THE DOMINANT ROCK OF THE BRONX? HOW WAS IT FOUND 
AND NAME ONE MINERAL THAT IS VISIBLE IN THIS ROCK. 

18. NAME THE SMALLEST FLOWERING PLANT AND ONE PARASITE 
FLOWERING PLANT. 

19. LIST THREE FACTORS THAT CONTRIBUTE TO THE ENVIRONMENTAL 
QUALITY OF A FRESH WATER POND. 

20. HOW MANY CENTIMETERS LONG IS THIS PAGE? HCW MANY INCHES WIDE? 



ERIC 



SCIENCE ENVIRONMENTAL PROGRAM 
DEPARTMENT OF EDUCATION 



93424 



1. WHAT PLANTS DO MONARCH CATERPILLARS FEED ON? 

2. WHAT IS POTABLE WATER? 

3. HOW MANY YEARS DO DANDELION PLANTS LIVE 
(IF NOT ELIMINATED BY UNNATURAL CAUSES.) 

4. WHAT ARE THE FOUR ELEMENTS THAT ARE FOUND IN ALL PROTEINS? 

5. WHAT IS THE NORTHERNMOST POINT AT WHICH THE SUN'S RAYS 
STRIKE THE EARTH DIRECTLY Oli_THE FIRST DAY OF SUMMER? 

6. WHAT IS AN ANNUAL (BOTANICALLY SPEAKING?) 

7. WHAT ARE THE TWO BASIC COMPONENTS OF SOIL? 

8. WHAT IS A MONOECIOUS PLANT? 

9. HOW WERE INDIAN CANOES IN THIS PART OF THE COUNTRY MADE? 

10. DEFINE CHLOROPHYLL. 

11. BONUS ; WHEN MANY EASTERN AMERINDIANS SPOKE OF THE 3 SISTERS, 
WHAT DID THEY MEAN? 

12. DEFINE MELANIN. 

13. WHAT ARE THE 3 TYPES OF ROCKS? 

14. HOW MANY CENTIMETERS LONG IS THIS PAGE? HOW MANY INCHES WIDE? 

15. NAME A DIOECIOUS TREE. 

NAME. DATE: 
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LENOX HILL-ENVIRONMENTAL EDUCATION PROGRAM, 1988-89 

School-Community Education Program 
Program Administrator; M. Morris Speiser 
Project Coordinator: David Stern 

Prepared by: 
Office of Research, Evaluation, and Assessment 
Instructional Support Evaluation Unit 
New York City Public Schools 

PROJECT DESCRIPTION 

The Lenox Hill Neighborhood Association and Community School 
Districts (C.S.D.s) 1 and 2 jointly conducted an environmental 
education program for elementary school students. Instruction on 
urban and rural ecology was provided through planned activities 
in the city in the vicinity of each school, and at Lenox Hill 
Camp in Bantam, Connecticut. The project seeks to develop 
positive attitudes and behavior toward environmental issues as 
well as toward ethnic, cultural, and racial diversity. 

In 1988-89, some 600 students in kindergarten through grade 
six from 20 schools participated in the program. Elementary 
school classes rather than individual students were selected for 
program participation. Classes were selected according to the 
following criteria: classes with large numbers of economically 
deprived students who did not have the opportunity to visit rural 
communities; classes where some of the students were bused in 
from other neighborhoods; and classes v'lth teachers willing to 
participate in a program involving in-service training, trips to 
the city, and a five-day residence at a camp. 

Instructional activities involved an in-city program based 
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on a multidisciplinary approach that integrated mathematics, 
language skills, social studies, arts, music, and physical 
education in the study of environmental science. Students also 
participated in a resident camping experience where environmental 
concepts were applied to rural ecosystems and group living. The 
project objective was for 80 percent of participating students to 
demonstrate a 20 percent increase in their knowledge of 
environmental science, energy conservation, and ecological 
concepts as measured by a criterion-referenced test. 

Project staff included a coordinator, an environmental 
education specialist, the camp director, an urban ecology 
counselor, environmental and csunping skills counselors, and three 
camp staff employees. The environmental education coordinator 
was responsible for the orientation sessions given to all 
participating teachers both in the city and at the camp. The New 
York State Legislature contributed $71 thousand to support 
project activities. 
EVALUATION METHODOLOGY 

Evaluation activities focused on analysis of students* raw 
scores on a project-developed test (see Appendix A). The test, 
designed to measure knowledge of environmental terms and 
concepts, consists of two equated forms of 33 items each. One of 
them was administered as a pretest, and the other as a posttest. 
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FINDINGS 

Complete test scores were reported for 443 students from 20 
different schools , eleven in C«S.D« 1 and nine in C.S.D. 2. The 
majority of the students were in the fifth grade , although 
roughly twenty percent of the students were in grades four or 
six. Table 1 presents students* mean raw scores by C.S.D. 
Overall, mean pretest raw score was 18.3 points (55.4 percent 
correct responses) , and mean posttest raw score was 20.5 points 
(62.1 percent correct), for a mean gain of 2.2 points (6.7 
percent correct). Although the mean scores for the C.S.D. s 
varied little, there was a marked difference in the performance 
of certain schools. P.S. 137, in C.S.D, 1, received the highest 
mean gain with 9 score points whereas P.S. 6, in C.S.D. 2, showed 
th.' lowest mean gain with a loss of 7.5 score points. 

Table 2 presents the percentage of students who met the 
project-set criterion for success. Twenty-four percent of the 
students increased their knowledge of environmental issues by 20 
percent from pretest to posttest. Only one school, P.S. 137 in 
C.S.D. 1, met the program objective, with 83.3 percent of 
participants meeting or surpassing the project-set criterion. 
*\S. 6, in C.S.D. 1, had the lowest success rate, with only one 
student meeting the project set criterion- 
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Table 1 

Students • Mean Raw Scores* on a Project-Developed Test, 

by C.S.D. 

Lenox Hill-Environmental Education Program, 1988-89 







Pretest 


M-an 


Posttest Mean 


Mean 


Gain 


C.S.D. 


N 


Raw 

Score 


Percent 
Correct 


Raw 
Score 


Percent 
Correct 


Raw 
Score 


Percent 
Correct 


1 


214 


18.4 


55.8% 


20.8 


63.0% 


2.4 


7.3% 


2 


229 


18.2 


55.2 


20.1 


60.9 


1.9 


5.8 


Total 


443 


18.3 


55.5 


20.5 


62.1 


2.2 


6.7 



'Perfect Raw Score =33 

Overall mean gain" was 6.7 percent. 
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TABLE 2 



Percentage of Students Meeting Project-Set Criterion* 
Lenox Hill-Environmental Education Program, 1988-89 









Meeting Criterion 


C.S.D. 


N 


N 


% 


1 


214 


46 


21.5% 


2 


229 


60 


26.2 


Total 


443 


106 


23.9 



^Eighty percent of students will demonstrate a 20 percent 
increase in their knowledge of environme.ital science, energy 
conservation and ecological concepts. 



* Twenty-four percent of participants met the project-set 
criterion for success. 
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CONCLUSIONS AMD P ECOMMENnATTQ^ S 

In 1988-89, the Lenox Hill-jSnvironmental education program 
was not successful in meeting its objective. Overall, only 24 
percent instead of 80 percent of participating students achieved 
a 20 percent increase in tJieir knowledge of environmental issues 
from pretest to posttest. One school, p.s. 137 in C.S.D. 1, had 
83 percent of participating students meeting the projact-set 
criterion. This school has also shown high success rates in 
previous evaluations. In 1987-88, one hundred percent of the 
students met the project-set criterion. It is not possible, with 
the information provided to the Office of Research, Evaluation, 
and Assessment to determine why this school had such a high 
success rate - All that is known about these students is that 
they were in the fifth grade, as were the majority of the other 
students. In the future, project staff si- ould examine the 
implementation of the project throughout the various schools in 
an attempt to discover why there is such a variation in scores. 

In addition, the fact that a different test form was 
administered as posttest raises the question of whether the 
pretest and posttest outcomes can be meaningfully compared. In 
the future, project staff should review and, if possible, replace 
the tests used to measure student growth. One test rather than 
two different ones should be considered. In addition, the 
project was designed to serve students in kindergarten through 
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grade six, although the majority of scores submitted were for 
fifth grade students* Previous evaluations have also focused on 
fifth grade students. If other grades are participating in the 
project, a sample of scores from all grades should be submitted 
for evaluation to measure the impact of the program across 
grades. 
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S, THE ;'IAIN ?KODUC£R IN* A FRESH WATER ?OND IS 

(A) FISH 

(B) TURTLE 

(C) ALGAE 

(D) YEAST 

9, A PLACE IN A CITY THAT LOOKS MOST LIKE A VILLAGE GREEN IS 

(A) A SCHOOL PLAYGROUND 

(B) AN EMPTY LOT 

(C) A SHOPPING CENTER 

(D) A PARK WITH GRASS AND TREES 

10. A PLANT GETS ENERGY FOR PHOTOSYNTHESIS FROM 

(A) FOOD 

(B) SUNLIGHT 

(C) CHLOROPHYLL 

(D) OXYGEN 

11. THE CHIEF CAUSE OF AIR POLLUTION IN A CITY IS 

(A) EXHAUST FRC:i CARS. 

(B) BURNING LE; £S. 

(C) FACTORIES. 

(D) BURNING FUEL IN HOMES. 

12. AN EXAMPLE OF FOSSIL FUEL IS 

(A) OIL 

(B) WOOD 

(C) ELECTRICITY 

(D) WATER 

13- A FRESH WA';ER AQUARIUM IS MOST LIKE 

(A) A RIVER 
(5) AN OCEAN 

(C) A POND 

(D) A BAY 

14. A POND WILL BECOME A SWAMP; A MEADOW WILL BECOME A WOODLAND. 
THIS IS CALLED 

(A) ADAPTATION 

(B) EVOLUTION 

(C) SUCCESSION 

(D) WATER CYCLE 

PLEASE TURN TO NEXT PAGE 
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PLEASE TURN TO NEXT PAGE 
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A2'.' ACuA.-,IUM lAXK CO 
AND A SNAIL. THE W 

(A) GRAVEL 




(B) 3REEN PLANT 

(C) FISH 

(D) SNAIL 




(A) 
(B) 
(C) 
(D) 



MAKE THEIR OWN FOOD 
GROW RAPIDLY- 

CONTAIN MANY KINDS OF CELLS 
DIGEST THEIR OWN FOOD 




17. AN INSTRUMENT WHICH YOU IvOULD USE TO MAKE SOMETHING LOOK 
BIGGER IS A 

(A) PERISCOPE 

(B) KALEIDOSCOPE 

(C) MICROSCOPE 

(D) KINESCOPE 

18. MOST FUNGI, SUCH AS MUSHROOMS AND MOLDS, GET THEIR FOOD I 

(A) ABSORBING WATER FROM THE SOIL 

(B) CAPTURING AND EATING INSECTS 

(C) EATING TINY ANIMALS IN POND WATER 

(D) LIVING ON OTHER PLANTS AND ANIMALS 

1:?. GAME REFUGES AND BIRD SANCTUARIES ARE SET UP IN ORDER TO 

(A) RAISE ANIMALS FOR HUNTING 

(B) GIVE ANIMALS A SAFE PLACE TO LIVE 

(C) KEEP HARMFUL ANIMALS TO THEMSELVES 

(D) FATTEN ANIMALS FOR SALE 

20. THE PLANT WHICH WOULD MOST LIKELY GROW IN THE WOODS IS A 

(A) CACTUS 

(B) FERN 

(C) WATER LILY 

(D) CORN 

21. THE PERSON WHO IS NOT POLLUTING THE ENVIRONMENTS IS 

(A) A WOMAN DRIVING A CAR 

(B) A MAN SMOKING A CIGARETTE 

(C) A GIRL RIDING A BICYCLE 

(D) A BOY DROPPING A CANDY WRAPPER ON THE GROUND 
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22. SOME .-LAMS CAN.-.C: GROW "^JDER THE TRZES IN A FCRESl dECAL'SE 
THERE IS TOO LITTLE 

(A) WATER 

(B) SOIL 

(C) SPACE 

(D) SUNLIGHT 

23. WATER FREEZES AT 

(A) 100 DEGREES C. 

(3) 32 DEGREES C. 

(C) 212 DEGREES C. 

(D) 0 DEGREES C. 

24. THE FOOL OF AN OWL IS MOSTLY 

(A) SEEDS 

(B) INSECTS 

(C) MICE AND OTHER SMALL ANIMALS 

(D) WILD BERRIES 

25. A MICROSCOPE CAN MAKE THINGS LOOK BIGGER BECAUSE IT HAS 

(A) LENSES 

(B) A MIRROR 

(C) A TUBE 

(D) CLIPS 

26. TAKE A LOOK AT THIS FOOD CHAIN: 

SUN GRASS COW PERSON 

THE PRODUCER IN THIS FOOD CHAIN IS 

(A) GRASS 

(B) SUN 

(C) COW 

(D) PERSON 

27. WHEN AIR PRESSURE IS HIGH AND THERE ARE ONLY CUMULUS CLOUDS, 
THE WEATHER WILL BE 

(A) STORMY 

(B) FAIR 

(C) COLD 

(D) HOT 

PLEASE TURN TO NEXT PAGE 
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AN' EXAiMPLE OF NATURAL RESOURCE THAT COXSTA\'rLi b^T'G 
REPRODUCED IS 

(A) A TREE 

(B) COAL 

(C) OIL 

(D) GOLD 

MANY ACORNS ARE ON THE LAWN. THE TREE WHICH YOU WOULD EXPECT 
TO FIND ON OR NEAR THE LAWN IS 

(A) MAPLE 

(B) ELM 

(C) OAK 

(D) PINE 

BEES ARE 

(A) NO'r HELPFUL TO MAN BECAUSE THEY STING 
(3) ONLY GOOD FOR MAKING HONEY 

(C) NOT HARMFUL OR HELPFUL TO MAN 

(D) HELPFUL BECAUSE THEY MAKE HONEY AND HELP TO 
CROSS POLLINATE FLOWERS 

A LIVING THING WHICH CAN PRODUCE ITS OWN FOOD IS A 

(A) PIG 

(B) ROBIN 

(C) TREE 

(D) MUSHROOM 

THE COLOR OF SOME ANIMALS HELP TO PROTECT THEM. THIS IS CALLED 

(A) HIBERNATION 

(B) MIGRATION 

(C) CAMOUFLAGE 

(D) NONE OF THESE 

THE MOST IMPORTANT REASON FOR PLANTING TREES AND GRASS ON A 
BARE HILLSIDE IS TO 

(A) PREVENT EROSION 

(B) PREVENT FOREST FIRES 

(C) PROVIDE FOOD FOR WILDLIFE 

(D) PROVIDE FOOD FOR FARM ANIMALS 



END 



PAGE ONE 

PLEASE DO UOT PUT ANY MARKS IN THE BOOKLET 

A CROSS SECTION IS CUT FROM THE BOTTOM OF A LIVING TREE, 
THE CROSS SECTION HAS 40 ANNUAL RINGS. THE AGE OF T'iE TREE 

(A) IS 40 YEARS 

(B) IS LESS THAN FORTY YEARS 

(C) IS MUCH MORE THAN FORTY YEARS 

(D) CANNOT BE DETERMINED 

A COMMON WEED THAT CAN BE FOUND GROWING ON A LAWN IS A 

(A) ROSE 

(B) PANSY 

(C) DENDELION 

(D) WATER LILY 

GREEN PLANTS ARE THE MOST IMPORTANTT PARTS OF A POND FOOD 
CHAIN BECAUSE 't-'HEY ARE 

(A) PRODUCERS 

(B) CONSUMERS 

(C) DECOMPOSERS 

(D) PARASITES 

THE PART OF TREE WHICH HELPS PROJECT IT FROM INSECTS THAT 
CAUSE DISEASE IS THE 

(A) ROOT 

(E) BARK 

(C) FLOWER 

(D) FRUIT 

WHEN A FROG IS A TADPOLE IT BREATHES WITH 

(A) LUNGS 

(B) GILLS 

(C) ITS HEAD 

(D) ITS FINS 

THE MOST IMPORTANT REASON FOR PLANTING TREES AND GRASS ON 
A BARE HILLSIDE IS TO 

(A) PREVENT E';OSION 

(B) PREVENT FOREST FIRES 

(C) PROVIDE FOOD FOR WILDLIFE 

(D) PROVIDE FOOD FOR FARM ANIMALS 
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7. MOST FUNGI/ SUCH AS MUSHROOMS AND >^OLDS , GET THEIR FCCD HV 

(A) ABSORBING WATER FROM THE SOIL 

(B) CAPTURING AND EATING INSECTS 

(C) EATING TINY ANIMALS IN POND WATER 

(D) LIVING ON OTHER PLANTS AND ANIMALS 

8. A BIRD WHICH IS FOUND IN GREAT NUMBERS IN THE CITY IS THE 

(A) BLUEBIRD 

(B) JUNCO 

(C) PIGEON 

(D) BALTIMORE ORIOLE 

9. THF: part of a plant that usually has seeds in IT IS THE 

(A) BUD 

(B) LEAF 

(C) STEM 

(D) FRbiT 

10. WILDLIFE REFUGES AND BIRD SANCTUARIES ARE SET CP IN ORDER TO 

(A) RAISE ANIMALS FOR HUNTING 

(B) GIVE ANIMALS A SAFE PLACE TO LIVE 

(C) KELP HARMFUL ANIMALS TO THEMSELVES 

(D) FATTEN ANIMALS FOR SALE 

11- A BIRD THAT HAS A SHARP CURVED BEAK AND SRTONG CLAWS 
(LIKE A HAWK OR AN OWL) FEEDS MOSTLY ON 

(A) MEAT 
(3) ACORNS 

(C) WHEAT AND CORN 

(D) INSLCTS 

12. THE ENVIRONMENT OF A PAVED SCHOOLYARD IS MOST LIKE T'^AT OF 
A DESERT BECAUSE 

(A) IT HAS CRACKS IN* THE PAVEMENT 

(B) IT IS DRY AND HAS POOR SOIL 

(C) VERY FEW PLANTS GROW IN IT 

(D) IT IS MADE OF CEMENT 

13. THE PART OF THE PLANT WHICH HOLDS IT IN THE SOIL IS THE 

(A) BRAwCH 

(B) LEAF 

(C) ROOT 
{?) TRUNK 



PLEASE TURN TO NEXT PAGE 
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THE PLANT WHIJH COL'LL G.-^OW BEST IX A FCRE'IT IS 

(A) CATTTAIL 

(B) MOSS 

(C) CACTUS 

(D) iViiLKWEED 

15. THE ANIMAL WHICH DOES NOT BELONG IN A CITY STREET HABITAT IS A 

(A) DOG 

(B) PIGEON 

(C) DUCK 

(D) GIRL 

16. ANIMAL WHICH BREATHES WITH GILLS IS A 

(A) BIRD 

(B) SNAKE 

(C) CAT 

(D) FISH 

17 • AN EXAMPLE OF A FOSSIL FUEL IS 

lA) PAPER 

(B) WOOD 

(C) COAL 

(D) WATER 

18. DURING THE SUMMER A SQUIRREL LIVES IN A NEST WHICH IS 

(A) ON A BRANCH OF A TREE 

(B) ON THP ROOTS OF THE TREE 

(C) ON THE GROUND 

(D) UNDER THE GROUND 

19. THE PART OF A CITY STREET IN WHICH WATER FLOWS TO THE SEWER 
IS CALLED THE 

(A) CURB 

(B) GUTTER 

(C) SIDEWALK 

(D) CROWN 

20. THE GREEN COLOR IN GRASS IS CALLED 

(A) GLUCOSE 

(B) CYTOPLASM 

(C) CHLOROPHYLL 

(D) CELLULOSE 

PLEASE TURN TO NEXT PAGE 
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21. THE MOST IMPORTANl REASON FOR CONSERVIKG TODAY IS THAT 

(A) OUR SUPPLY OF FOSSIL FUELS IS LIMITED 

(B) IT SAVES THEM 

(C) FOSSIL FUELS ARE HARD TO FIND 

(D) THERE ARE TOO MANY CARS AND TRUCKS 

22. IF YOU WANT TO LOOK AT A SPECIMEN UNl^ER A MICROSCOPE, 
YOU PUT IT ON A 

(A) LENS 

(B) SLIDE 

(C) DROPPER 

(D) MIRROR 

23. THE PART OF A TREE WHICH CAN MAKE FOOD IS THE 

(A) BRANCH 

(B) LEAr* 

(C) ROOT 

(D) TRUNK 

24. A TYPE OF PLANT THAT HELPS BREAK DOWN A ROTTING LOG IS 

(A) FUNGUS 

(B) CACTUS 

ir) DANDELION 
(0) CATTTAIL 

25. AN INSTRUMENT USED TO MEASURE AIR PRESSURE IS A 

(A) WEATHER VANE 

(B) THERMOMETER 

(C) BAROMETER 

(D) ANEMOMETER 

26. THE ENERGY IN OIL, COAL, AND ELEc ICITY COMES FROM 

(A) MUSCLES 

(B) THE MOON 

(C) THE SUN 

(D) WATER 

27. ECOLOGY IS 

(A) THE STUDY OF FOSSILS 

(B) THE STUDY OF LIVING THINGS AND THEIR ENVIRONMENT 

(C) THE STUDY OF PLANTS 

(D) THE STUDY OF ANIMALS 
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15. AN EXAiMPLE OF XATURAL REbOUKCE THAT IS COXSTAXTIV BEI,\G 
REPKODUCED IS 

(A) A TREE 

(B) COAL 

(C) OIL 

(D) GOLD 

29. A POND WILL BECOME A SWAMP: A FIELD WILL BECOME A FOREST, 
THIS IS CALLED 

(A) ADAPTATION 

(5) EVOLUTION 

(C) SUCCESSION 

(D) THE WATER CYCLE 

30. THE COLOR OF SOME ANIMALS KELPS TO PROTECT THEM. 
THIS IS CALLED 

(A) HIBERNATION 

(B) MIGRATION 

(C) CAMOUFLAGE 

(D) NONE OF THESE 

31. AFTER A HEAVY RAIN, THE WATER AT THE EDGE OF A LAKE MAY 
HAVE A BROWN COLOR. THIS IS MOST LIKELY DUE TO 

(A) REPRODUCTION OF PLANTS 

(B) SOIL BEING WASHED INTO THE LAKE 

(C) ANIMALS IN THE WATER 

(D) ROCKS IN THE WATER 

32. DANDELION SEEDS ARE USUALLY CARRIED AWAY FROM THE PLANT BY 

(A) WIND 

(B) WATER 

(C) MAN 

(D) NONE OF THESE 

33. THIS IS A KIND OF FOOD CHAIN: 

SUN LEAF CATTERPILLAR BIRD 

THE PRODUCER IN THIS FOOD CHAIN IS THE 

(A) LEAF 

(B) BIRD 

(C) CATERPILLAR 

(D) NONE OF THESE 



END 
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GODDARD-RIVERSIDE ENVIRONMENTAL EDUCATION PROGRAM, 1988-89 

School-Community Education Program 
Program Administrators M. Mcrris Speiser 
Project Coordinator: Robert Kanegis 

Prepared by: 
Office of Research, Evaluation, and Assessment 
Instructional Support Evaluation Unit 
New York City Public Schools 

PROJECT DESCRIPTION 

The GoJldard-Riverside Environmental Education program 
provides instruction in environmental science and experiences in 
the natural and urban environmsnts for elementary school pupils 
in Community School Districts (C.S.D.s) 3 and 6, The goal of the 
program is to promote awareness of and concern for environmental 
issues. 

In 1988-89, some 552 pup: Is from 16 elementary schools took 
part in the project. Studt ^,ts from fourth througr sixth grade 
classes were eligible for participation. Classes were selected 
if their teachers were interested in environmental science, 
willing to attend special orientation and training workshops, 
able to spend a week at the Goddard-Rlverside Field Campus with 
thp"^r students., and willing to use the environmental education 
curriculum to p ^mote student cognitive development in other 
learning areas. 

Eighteen groups of students and their teachers spent one 
week each at the Goddard-Ri .side Field Campus in Rifton, New 
York. Proj<^ct instruction at the camp focused on the life 
support systems essential to the total environment. Participants 
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TABLE 1 

Students' Mean Raw Scores" on a Program-Develop ad Test, by School 
Goddard-Riverside Environmental Education Program, 1988 39 



Pretest Mean Posttest Mean Mean Gain 

Raw Percent Raw Percent Raw Pt :cent 



School 




N 


Score 


Correct 


Score 


Correct 


Score 


Correc 


District 


3 
















P.S. 


9 




31 


13.2 


40.0% 


16.2 


49.1% 


3.0 


9.1% 


P.S. 


76 




21 


7.3 


22.1 


17.2 


52.1 


9.9 


30.0 


P.S. 


84 




33 


13.3 


40.3 


17.0 


51.5 


3.7 


11.2 


P.S. 


144 




30 


15.2 


46.1 


17. 3 


52c4 


2.1 


6.4 


P.S. 


14 5 




63 


14.5 


43 .9 


14. 0 


42.4 


-0.5 


-1. 


P.S. 


166 




66 


15.5 


47.0 


16. 3 


49.4 


0.8 


2.4 


P.S. 


180 




32 


16.4 


49. / 


20. 1 


60.9 


3.7 


11.2 


District 


6 
















P.S. 


128 




28 


16.3 


49.4 


21.3 


64.5 


5.0 


15.2 


P.S. 


13 2 




60 


11.9 


36.1 


16.1 


48.8 


4.2 


12.7 


P.S. 


152 




32 


13. S 


42.1 


18.8 


57.0 


4.9 


14.8 


P.S. 


153 




29 


10.6 


32.1 


15.2 


46.1 


4.6 


13.9 


P.S. 


173 




32 


10.1 


30.6 


1/.8 


53.9 


7.7 


23.3 


P.S. 


189 




61 


12.0 


36.4 


20. 1 


60.9 


8.1 


24.5 


P.S. 


192 




34 


18.2 


55.2 


20.2 


61.2 


2.0 


6.1 


TOTAL 




552 


13.6 


41.2 


17.5 


53.0 


3.8 


11.5 



"Perrect Raw Score = 33. 

Overall, mean gain was 11.5 percent points. 
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TABLE 1 

Students' Mean Raw Scores" on a Program-Develop ad Test, by School 
Goddard-Riverside Environmental Education Program, 1988 39 



Pretest Mean Posttest Mean Mean Gain 

Raw Percent Raw Percent Raw Pt :cent 
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N 


Score 


Correct 


Score 


Correct 


Score 
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16. 3 


49.4 
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32 
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20. 1 
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15.2 
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29 


10.6 


32.1 


15.2 


46.1 


4.6 


13.9 


P.S. 


173 




32 


10.1 


30.6 


1/.8 


53.9 


7.7 


23.3 


P.S. 


189 




61 


12.0 


36.4 


20. 1 


60.9 


8.1 


24.5 


P.S. 


192 




34 


18.2 


55.2 


20.2 


61.2 


2.0 


6.1 


TOTAL 




552 


13.6 


41.2 


17.5 


53.0 
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11.5 



"Perrect Raw Score = 33. 

Overall, mean gain was 11.5 percent points. 
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percent increase. Analyzed by school, these data show that 
student performan'-e varied considerably. Mean pretest raw scores 
ranged from 7.3 to 18.2 points, mean posttest raw scores ranged 
from 14 to 21.3 points, and mean gains ranged from -0.5 to 9*9 
raw score points. In percentage points, these mean gains ranged 
from a less of 1.5 percent to 30 percent. 

Table 2 shows the percentage of students who achieved the 
^jroject-set criterion for success. Overall, 34.8 percent of 
participants increased their knowledge of science concepts. P.S. 
76 nad the highest percentage of successful students (71.4 
percent) . 

CONCLUSIONS AND RECOMMEND? ^ JIONS 

In 1988-89, the Goddard-Riverside Environmental Education 
Program was not successful, since only 34.8 percent of 
participants increased their knowledge ot science concepts by at 
least 2 0 percent. Previous evaluations have suggested that grade 
levels could be responsible for the variations observed in 
student performance. This year's evaluation found little 
difference in scores between grades. 

In general, all students shewed relatively small mean gains, 
one explanation for this might be that the evaluation instrument 
does not accurately measure project activities or that the 
activities themselves do not provide the necessary knowledge for 
students to perform better on the test. Project staff should 
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TABI£ 2 

Percentage of Students Meeting Project-Set Criterion/ by School 
Goddard-Riverside ' Invironmental Education Program, 1988-89 



School 


N 


Meeting Criterion 
N % 


District 3 








P.S. 


9 


31 


6 

w 




P.S. 


76 


21 


15 


714 


P.S. 


84 


33 


10 


30.3 


P.S. 


144 


30 


6 


20.0 


P.S. 


145 


63 


6 


9.5 


P.S. 


166 


66 


12 


18. 2 


P.S. 


180 


32 


7 


21.9 


District 6 








P.S. 


128 


28 


13 


46.4 


P.S 


132 


60 


21 


35.0 


P.S. 


152 


32 


14 


43.8 


P.S. 


153 


29 


12 


41.4 


P.S. 


173 


32 


20 


62.5 


P.S. 


189 


61 


41 


67.2 


P.S. 


192 


34 


9 


26.5 


TOTAL 


552 


192 


34.8 



^Eighty percent of pupil participants will demonstrate an 
increase of at least 20 percent in their knowledge of science 
concepts at posttest. 

Thirty-five percent of participants achieved the project- 
set criterion. 
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correlate skills developed through project activities and the 
skills included in the testing instrument to determine if both 
adequately match the stated goals and objectives of the project. 
While this recommendation is made to improve future evaluations 
of the project, it does not deny that the project may, indeed, 
provide children with the unique and exciting experience of 
spending a week at the Goddard-Riverside Field Campus. This 
might be one of the purposes of the project, but if i-c is it 
should be stated in the project description • 
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GODDAP.D-RIVERSIDE ENVIRONMENTAL APPENDIX A 

EDUCA'xxON PROGRAM PRE- AND POST-TEST 93428 



KNOWLEDGE AND CONCEPTS OF SCIENCE 



PLEASE DO NOT PUT ANY MARKS IN THIS BOOKLET 



1, THE BARK OF A TREE IS MOST LIKE 

(A) A STOMACH 

(B) A BRAIN 

(C) SKIN 

(D) BONES 

2, MOST GREEN PLANTS TAKE WATER THROUGH THEIR- 

(A) BUDS 

(B) ROOTS 

(C) FLOWER 

(D) STEM 

3, A HABITAT IS 

(A) A TYPE OF RABBIT 

(B) THE STUDY OF THE HABITS OF ANIMALS 

(C) A PLACE WHERE PLANTS AND ANIMALS NATURALLY LIVE AND GROW 

(D) SOMETHING AN ANIMAL EATS 

4, CONSERVATION IS BEST DESCRIBED AS 

(A) BUILDING OF HOMES IN NATURAL SURROUNDINGS 

(B) SAVING MONEY TO BUT PARKS AND FORESTS 

(C) SURVIVAL OF THE FITTEST 

(D) CARi: AND PROTECTION OF NATURAL RESOURCES 

5- WITHOUT GREEN PLANTS VvE WOULD DIE BECAUSE PLANTS PROVIDE US WITH 

(A) A MAJOR SOURCE OF BUILDING MATERIALS 

(B) A MAJOR SOURCE OF OXYGEN AND FOOD 

(C) A MAJOR SOURCE OF SHADE 

6. BIRDS HELP US BECAUSE THEY 

(A) FIGHT WITH SQUIRRELS 

(B) EAT INSECTS THAT DESTROY CROPS 

(C) STORE NUTS FOR WINTER 

(D) MAKE NESTS IN TREES 

7, A FRESH WATER AQUARIUM IS MOST LIKE 

(A) A RIVER 

(B) AN OCEAN 

(C) A POND 

(D) A BAY 



GODDARD -RIVERS IDE ENVIRONMENTAL 
EDUCATION PROGRAM 



PRE- AND POST-TEST 
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KNOWLEDGE AND CONCEPTS OF SCIENCE 



8. WOOD IS USED BY PEOPLE IN MANY WAYS. WHICH FOUR OF THE FOLLOWING 
CAN BE MADE OF WOOD? 



9. WHICH OF THE FOLLOWING CAN BE CONSIDERED PART OF OUR ENVIRONMENT? 

(A) AIR 

(B) WATER 

(C) SOIL 

(D) CARS 

(E) ALL OF THE ABOVE 

10. SOME MAMMALS HIBERNATE (SLEEP THROUGH) THE WINTER BECAUSE 

(A) THEY ARE ALLERGIC TO SNOW 

(B) THEY CANNOT FIND ENOUGH FOOD IN THE WINTER 

(C) THEY NEED A REST 

(D) ALL THE BIRDS HAVE FLOWN SOUTH 

11. WHAT HAPPENS TO THE TRASH AND GARBAGE THAT IS LEFT GU THE 
CURB FOR PICKUP? 

(A) IT GETS DUMPED 

(b) IT GETS BURNED 

(C) IT GETS BURIED 

(D) IT GETS IGNORED 

(E) ALL OF THE ABOVE 

12. THE ENERGY CRISIS HAS COME ABOUT BECALSE 

(A) WE HAVE BEEN CONSEkVING WISELY 

(B) WE HAVE DEVELOPED OTHER FORMS OF RENEWABLE ENERGY 

(C) WE HAVE BEEN USING UP OUR FOSSIL FUELS 

13. WHALES ARE AN ENDANGERED SPECIES BECAUSE 

(A) THERE IS NOT ENOUGH WATER FOR THEM TO SWIM IN 

(B) THEY ARE BEING KILLED BY HUMANS 

(C) THEY DON'T HAVE. ENOUGH FOOD TO EAT 

(D) THEY ARE BEING KILLED BY CERTAIN KINDS OF FISH 

14. A BIRD WITH A LONG, SHARP BILL WOULD BE BEST ADAPTED FOR 

(A) CRUSHING SEEDS 

(B) STRAINING FOOD FROM MUD 

(C) SPEARING FISH 



(A) 
(B) 
(C) 
(D) 



FURNITURE 
CH4ENT 
BRICK 
FUEL 



(E) HOUSE 

(F) GLASS 

(G) PAPER 
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GODDARD-RI'vTSnSIDE ENVIRONMENTAL 

EDUCATION PROGRAM PRE- AND POST-TEST 
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KNOWLEDGE AND CO'^?CEPTS OP SCIENCE 



15. PEOPLE ARE A PART OF THEIR ENVIRONMENT. THIS MEANS 

(A) YOU ARE A PART OF EVERYTHING AROUND YOU 

(B) YOU AFFECT THINGS AROUND YOU AND THEY AFFECT YOU 

- - . - (C) . YOU ARE RESPONSIBLE FOR WHAT HAPPENS IN THE WORLD 
(D) ALL OF THE ABOVE 

16. AN OWL THAT EATS A MOUSE THJ-l' EATS CORN IS AN EXAMPLE OF 

(A) SURVIVAL OF THE FITTEST 

(B) A BALANCED DIET 

(C) A FOOD CHx'^IN 

(D) EINSTEIN'S THEORY OF RELATIVITY 

17. A DECOMPOSER IS 

(A) AN INSECT THAT EATS LEAVES 

(B) A DETERGENT THAT CLEANS POLLUTED WATER 

(C) A BACTERIA OR FUNGUS THAT BREAKS DOWN DEAD PLANTS 
AND ANIMALS 

(D) A BIRD THAT BREAKS TOIGS TO MAKE ITS NEST 

18. WHICH FOUR OF THE FOLLOWING WOULD BE CONSIDERED RENEWABLE 
AND CLEAN ENERGY SOURCES 

(A) SOLAR (E) WATER 

(B) NUCLEAR (F) COAL 

(C) WIND (G) GEOTHEPJ'iAL 

(D) OIL 

19. WHICH MATERIAL IS NOT EASILY RECYCLED 

(A) PAPER 

(B) GLASS 

(C) PLASTIC 

(D) METAL 

20. THE BEST WORD TO DESCRIB^' THE RELATIONSHIP IN A COMMUNITY IS 

(A) HIBERNATION 

(B) INTERDEPENDENCE 

(C) INDUSTRIALIZATION 

(D) ADAPTATION 

21. BEING HEALTHY IS 

(A) EATING RIGHT 

(B) BEING ENERGETIC AND ACTIVE 

(C) KNOWING YOU CAN DO GOOD THINGS AND L.OING THEM 

(D) FEELING GOOD 

(E) ALL OF THE A30VE 
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22. kklU FALLING INTO A LAKE FROM WHICH WATER VAPOR THEN iDVAPORATES 
TO FROM CLOUDS, FROM WHICH IT RAINS AGAIN IS A GOOD EXAf>lPLE OF 

(A) NATURAL TRANSPORTATION 

(B) POLLINATION 

(C) PHOTOSYNTHESIS 

(D) NATURAL CYCLE 

23. WHO IS NOT POLLUTING THE ENVIRONMENT? 

(A) A WOMAN DRIVING A CAR 

(B) A MAN SMOKING A CIGARETTE 

(C) A GIRL RIDING A BICYCLE 

(D) A BOY DROPPING A CANDY WRAPPER ON THE GROUND 

24. WHICH FOUR NATURAL COMMUNITIES ARE WE MOST LIKELY TO FIND 
IN KEW YORK STATE? 



(A) FOREST 

(B) LAKE 

(C) ARCTIC TUNDRA 

25. PEOPLE ARE GOOD EXAMPLES 

(A) OMNIVORES 

(B) CARNIVORES 

(C) PRODUCERS 

(D) HERBIVORES 



(D) DESERT 

(E) THICKET 

(F) MEADOW 



26. A POND TURNING INTO A MARSH, TURNING INTO A MEADOW, TURNING 
INTO A THICKET, AND THEN FINALLY INTO A FOREST OVER A LONG 
PERIOD OF TIME IS AN EXAMPLE OF 



(A) BICLOCICAL SUCCESSION 

(B) MAGIC 

(C) A LOT OF DRY, HOT WEATHER 

(D) FOOD CHAIN 



27. WHICH OF THE FOLLOWING ITEMS CAN CAUSE WATER POLLUTION? 

(A) SEWAGE 

(B) DETERGENT 

(C) BACTERIA 

(D) ALL OF THE ABOVE 

(E) NON£ OF THE ABOVE 



28. IN A TROPICAL FOREST YOU WOULD FIND 



(A) TARZAN 

(B) VERY TALL TREES 

(C) LOW HUMIDITY 

(D) GRASS 

(E) NONE OF THE ABOVE 
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29. POLLUTION CAN BE CAUSED BY 

(A) CARS AND BUSES 

(B) FACTORIES 

(C) NUCLEAR REACTORS 

(D) ALL OF THE ABOVE 

30. A GOOD EXAMPLE OF CAf^OUFLAGE IS 

(A) A BIRD FLYING SOUTH IN THE WINTER 

(B) A BEE TAKING POLLEN FROM A FLOWER 

(C) A WHITE SNOW SHOE RABBIT IN THE SNOW 

(D) A BEAR STANDING IN A MEADOW 

31. ONE WAY BY WPilCH PEOPLE DESTROY NATURAL CYCLES IN 

(A) PLANTING TREES 

(B) GROWING VEGETAL ^ES IN THEIR GARDEN 

(C) SPRAYING PESTICIDES ON TREES 

(D) COOKING IN A SOLAR SYSTEM 

32. ANIMALS COMPETE FOR WHICH OF THE FOLLOWING RESOURCES: 

(A) FOOD 

(B) WATER 

(C) TERRITORY 

(D) ALL OF THE ABOVE 

33. DINOSAURS NO LONGER EXIST BECAUSE THEY COULD NOT: 

(A) ADAPT TO THEIR ENVIRONMENT 

(B) FIND GOOD HOUSING 

(C) HIDE FROM THEIR ENEMIES 

(D) RAISE THEIR YOUNG PROPERLY 



THE END 
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ETHNIC AWARENESS PROGRAM, 1988-89 

School -Compiunity Education Program 
Program Administrator: M. Morris Speiser 
Project Coordinator: Howard Levine 

Prepared by: 
Office of Research, Evaluation, and Assessment 
Instructional Support Evaluation Unit 
New York City Public Schools 

PROJECT DESCRIPTION 

The Ethnic Awareness Program is an after-school project 
about Afro-American and Hispanic-American history and culture 
designed for students in Community School District (C.S.D.) 9. 
The project seeks to improve pupils' skills, increase their 
awareness of diverse ethnic heritages, and fostar their 
appreciation and respect for their own and other ethnic groups. 
In 1988-89, the program operated in four elementary schools, P.S. 
28, 64, 70, and 90, serving 100 pupils in grades one through six. 
Students interested in the project and recommen'^ed by their 
school principals were selected for project participation. 

Participants attended three two-hour sessions a week for a 
total of 26 weeks. Project activities included field trips to 
community facilities, meetings with leaders of cultural 
organizations, and the staging of dramatic and musical 
performances based on ethnic themes. The project objective was 
for 80 percent of participants zo demonstrate an increase in 
their knowledge of Afro-American and Hispanic-American history 
and culture by achieving a gain of at least 30 percent from pre- 
to posttest. Project staff included four teachers and four 
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paraprofessionals. The New York State Legislature provided $18 
thousand to fund the program. 
EVALUATION METHODOLOGY 

Project impact was assessed by an analysis of students' 
scores on a 36-item project-developed test on ethnic awareness. 
The test consisted of multiple-choice items on history an 
culture, as well as identifications emphasizing map knowledge 
(see Appendix A) and was given on a pre- and posttest basis at 
the beginning and end of project activities. 
FINDING .^ 

Complete test scores were reported for 30 students from P.S. 
64. No data was submitted from P.S. 28 ^ 70, or 90. overall, 
mean pretest raw score was 15.3 points (42.5 percent correct 
responses), and mean posttest raw score was 26.6 points (73,9 
percent correct), for a mean gain of 11.3 points or 31 percent 
points (see Table 1). overall, 63.3 percent of participants met 
or surpassed the project-set criterion for success of a 30 
percent increase. 
CONCLUSIONS AND RECOMMENDATIONS 

In 1988-89, the Ethnic Awareness program was not successful 
in meeting its objective. Sixty-three instead of 80 percent of 
participants demonstrated en improvement in their knowledge of 
Afro-American and Hispanic -American history and culture by 
achieving a 30 percent increase from pre- to posttest. 



TABLE 1 

Students* Mean Raw Scores* on a Project-Developed Test, 

by School 
Ethnic Awareness Program, 1988-89 



Pretest Mean Posttest Mean Mean Gain 

Raw Percent Raw Percent Raw Percent 
Score Correct Score Correct Score Correct 



Students 

Meeting Criterion^ 14.1 39.2% 27.3 75.8% 13.2 36.7% 
(N=19) 

Students not 

Meeting criterion'' 17.5 48.6 25.6 71.1 8.1 22.5 

(N=ll) 

Total 

(N=30) 15.3 42.5 26.6 73.9 11.3 31.0 



^Perfect Raw Score=36. 

^Eighty percent of participants will make a posttest gain of at least 
30 percent. 

Overall, 63.3 percent of participants met the project set 
criterion of success. 
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Following recommendations made in previous years, project 
staff revised the objective to include a quantitative measure of 
project success. This was stated as, "80 percent of participants 
will achieve a gain of 30 percent at posttest." Many of the 
students not meeting the project-set criterion received pretest 
scores as high as 30 score points. This makes an improvement of 
30 percent impossible for these students (ceiling effect) . It is 
recommended that the objective be revised. The revised objective 
could state, for instance, "Seventy-five percent of participants 
will increase their knowledge of Afro-American and Hispanic- 
American history and culture by achieving a gain of at least 20 
percent." In addition, project staff may wish to expand the test 
by adding questions of various difficulty levels and deleting 
those questions students know the answers to before entrance to 
the program. 
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PART I 



Directions for Questions 1-25; Circle the correct answer. 



EXAMPLE: What Civil Rights leader won the Nobel Peace Prize? 

a) Malcolm X d) Martin Luther King, Jr, 

b) Marcus Garvey e) Adam Clayton Powell, jr. 



1* The first humans inhabited: 

a) Europe, b) South America, 

b; Africa. d) Asia. 



2, The Inhabitants of Puerto Rico, encountered by Columbus 
were; 

a) Tainos* c) Incas. 

b) Carib. d) Mayas. 



3. Reggae music originated in: 

a) Barbaaos. c) Trinidad, 

b) Jamaica. d) Grenada. 



The name of the Puerto Rican Anthem is: 

a) Mi Viejo San Juan. c) Preciosa. 

b) La Borincuena. d) El Jibaro, 



5. The merengue is a popular dance of: 

a) Cuba, c) Puerto Rico, 

b) Dominican Republic, d) Haiti. 



6. The ancient stoneheads that were built in the Gulf of 

Mexico reflected the friendship between the Pre-Columbian 
people and the ; 



a) Asians. 

b) Australians. 



c) Arabs. 

d) Africans . 



if-* 
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7. The first European colony in the New world was: 

a) Puerto Rico. c) Dominican Republic. 

b) Cuba. d) Brazil. 

8. A Puerto Rican composer was: 

a) Cervantes. c) JoSe Marti. 

b} Matoc. d) Rafael Hernandez. 

9. Tiie two countries that share the island of Hispanola are: 

a) Trinidad. & Tobago. - c) Dominican Republic 

& Haiti. 

b) Cuba & Puerto Rico. d) St. Thomas & St. John. 

10. Dances such as the rumba, the limbo and cake walk were 
influenced by: 

a) Puerto Rico. c) Africa. 

b) Spain. d) Peru. 

11. An instrument developed in Africa and used in Latin 
percussion ensembles is the: 

3) Conga. c) Guitar, 

b) Piano. d) Flute. 

""^^^ captured and forcibly brought to the New 

World? 

a) Europeans. c) Asians. 

Aztecs. d) Africans. 

13. The influential Muslim leader who was the National 

spokesman for the Nation of islam during the late 1950's 
was: 

a) Luis Farrakham, c) Malcolm x. 

b) Franz Fanon. d) Muhammad Ali. 



ERIC 



99 



Pre • post Test 



93429 



14. A Major supplier of tropical produce to the northeast is: 

a) Dominican Republic. c) Puerto Rico. 

b) Cuba. d) Argentina. 



15. Combinations of African, European and Pre-Colombian cultures 
may be found in: 

a) Capreira. . c) The Americas, 

b) Africa. d) All of the above* 



16. Langston Hughes was a: 

a) Painter. c) Poet. 

b) Scientist. d) Hc^itian liberator. 



17. Pablo Picasso was best known for his work in: 

a) Science. c) Writing. 

b) Art. d) Politics. 



18. Roberto Clemente was at 

a) ^Famous scientist. c) Baseball player & humanitarian 

b) Famous opera singer. d) Union leaaer. 



19. Charles Drew was famous for his work on: 

a) Drawing cartoons. c) Writing short stories. 

b) Blood/Plasmare. d) Television. 



20. Herman Badillo is best known for his work in: 

a) poetry. c) Politics. 

b) Art. d) Medicine. 
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21 . Brazil is a (n) : 



a) Spanish -speaking 
American country, 

b) French-speaking 
American country. 



c) English -speaking 
American country. 

d) Portuguese -speaking 
American country. 



22. Harriet Tubman helped: 

a) Many slaves escape 
to freedom. 

b) Develop a cure 
for cancer. 



c) Capture runaway 
slaves. 

d) Many slaves return 
to slavery. 



23. Paul Robeson was a well-known: 



a) Doctor and lawyer. 

b) Singer and civil 
rights leader. 



c) Poet and doctor. 

d) Civil rights leader 
and doctor. 



24. 



Dr. Martir Luther King, Jr.'s Eirst important step in the 
Civil Rights movement occurred after: 



a) John Carver was 
arrested . 

b) He was arrested 
m California. 



c) Booker T. Washington 
was arrested. 

d) Rosa Parks was arrested, 



25. Booker T. Washington was; 

a) The founder of 
Tuskegee Institute. 

b) A lawyer in the 
Civil Rights Movement. 



c) A Composer of music. 

d) The scientist who discovered 
a cure for heart disease. 
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ANSWER KEY WITH TOPICS 





ANSWERS 


TOPICS 


Example 


D 


Black History 


1. 


B 


African History 


2. 


A 


Puerto Rican History 


3. 


B 


Jamaican Culture 


4. 


B 


Puerto Rican Culture 


• 


B 


Dominican Republic Culture 


6. 


D 


African History 


7. 


C 


World History 


8. 


D 


Puerto Rican Culture 


9. 


C 


Dominican Rep. & Haitain History 


10. 


C 


African Culture 


11. 


A 


African & Latin Culture 


12. 


D 


African History 


13. 


C 


Black History 


14. 


C 


Dominican Republic Industry 


15. 


C 


World History 


16. 


C 


Black History 


17, 


B 


Puerto Rican History 


18. 


C 


Puerto Rican Histofy 


19. 


B 


Black History 


20. 


C 


Puerto Rican History 


~ 21. 


D 


Brazilian History 


22. 


A 


Black History 


23. 


B 


Black History 


24. 


D 


Black History 


25. 


A 


Black History 



ERIC 



102 



ANSWER KEY FOR PART II 



93429 



ANSWERS 



1. 


North America 


2. 


Cuba 


3. 


Jamaica 


4. 


Haiti/Dominican Republic 


5. 


Puerto Rico 


0 • 


ine Lesser Antilles 


7. 


Central America 


8. 


South America 


9. 


Europe 


10. 


Africa 


11. 


New York City 
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